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(54) Apparatus for layered video coding 

(57) A video signal layering-encoding system 
according to the present invention has at least either a 
frequency distribution unit to judge a frequency distribu- 
tion in an input video signal or a motion judgment unit to 
judge the motion of an input video signal. With this, 
encoding quantity control according to the characteris- 
tics of the input video signal can be performed between 
layers. Also, with selection of encode modes and shar- 
ing of a motion vector, the encoded data of a bidirection- 
ally predicted frame can be reduced and the encoding 
efficiency of a high resolution signal can be increased. 

A digital broadcast decoding system according to 
the present invention can readily display a plurality of 
broadcasting programs on different channels onto a 
small screen within a main screen when digital broad- 
casts are received, by a decoding method in which 
processing is easy structurally simple circuitry, and soft- 
ware. 

In a digital broadcasting signal storage according to 
the present invention, by thinning out DCT coefficients 
to reduce the quantity of data to be stored or to slow 
down the storing speed of requisite data and by addition 
of a video signal decoding section and video signal 
encoding section for encoding video signals again, the 
video signal format in a storage medium can be fixed as 
a single format. 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the invention 

[0001] The present invention relates to an encoding 
quantity control method and video signal encoding 
apparatus for spatial scalability profile which is hierar- 
chical coding in a spatial axis direction standardized 
(ISO/IEC 13818-2) by the ISO Moving Picture Experts 
Group (MPEG), or for other hierarchical coding tech- 
niques, and also relates to the storing and decoding of 
video signals compressed by the MPEG standard. 

2. Description of the Prior Art 

[0002] Conventional video signal layering-encoding 
apparatus is based on the spatial scalability profile 
which is hierarchical coding in a spatial axis direction 
standattfized (ISO/tEC 13818-2) by the ISO Moving Pic- 
ture Experts Group (MPEG). 

[0003] The constitution and operation of the conven- 
tional video signal layering-encoding apparatus will 
hereinafter be described in reference to FIG. 22, which 
is a block diagram of the conventional video signal lay- 
ering-encoding apparatus. 

[0004] As shown in FIG. 22, an input video signal 
5000 is converted to a lower resolution video signal than 
the input video signal 5000 by a resolution converter 
5001. 

[0005] A motion detector 5002 stores the output of the 
resolution converter 5001 (the encoded frame of the 
input video signal 5000) in image memory 5003 and 
also detects the motion of a macroblock unit from the 
encoded frame and the previously encoded and 
decoded past reference frame in the image memory 
5003. A motion compensator 5004 outputs a differential 
signal between the video signal of the encoded frame 
and tfte reproduced video signal of the reference frame 
detected by the motion detector 5002 in the unit of a 
macroblock. A discrete cosine transform (DCT) unit 
5005 outputs the output (differential signal) of the 
motion compensator 5004 as DCT coefficients for each 
block. A quantizer 5006 quantizes the DCT coefficients 
by a quantization step (i.e., a divisor employed in quan- 
tization) specified by an encoding rate controller 5007 
and then outputs the quantized DCT coefficients. An 
inverse quantizer 5008 inversely quantizes the DCT 
coefficients quantized at the quantizer 5006 by the 
quantized quantization step and then outputs the 
inversely quantized DCT coefficients. An inverse DCT 
(I DCT) unit 5009 outputs the output of the inverse quan- 
tizer 5008 as inverse DCT coefficients. A motion com- 
pensator 5010 generates a reproduced video signal by 
adding the output of the IDCT unit 5009 and the video 
signal of the reference frame whose motion was com- 
pensated at the motion compensator 5004, and then 



stores the reproduced video signal in the image mem- 
ory 5003. A variable-length encoder 5011 variable- 
length encodes the output of the quantizer 5006 and a 
predetermined flag and then outputs the variable-length 
5 encoded video signal. A buffer 501 2 stores the variable- 
length encoded video signal temporarily and adjusts the 
output speed of output data thereof. That is, the buffer 

5012 outputs a variable-length encoded video signal 
with low resolution. 

10 [0006] The encoding rate controller 5007 determines 
the quantization step of the encoded frame for each 
macroblock, based on the output (differential signal) of 
the motion compensator 5004, the encoded length of 
the encoded video signal, and the residual quantity 

is information on the buffer 5012. 

[0007] On the other hand, the resolution converter 

5013 resolution converts the output (reproduced video 
signal) of the motion compensator 5010, i.e., converts 
the resolution of the reproduced video signal to the 

20 same resolution as the input video signal 5000 and then 
stores it in image memory 5015. A motion detector 5014 
stores the encoded frame of the input video signal 5000 
in the image memory 5015 and also detects the motion 
of a macroblock unit from the encoded frame, the previ- 

25 ously encoded and decoded past reference frame (high 
resolution video signal) in the image memory 5015, and 
from the reference frame that is the video signal of the 
same time among the low resolution signals which are 
the outputs of the resolution converter 5013. That is, in 

30 this motion detection, the motion detector 5014 com- 
pares the encoded frame of the input video signal 5000 
with the above-mentioned past reference frame, the 
above-mentioned reference frame of the same time, 
and a reference frame generated by a combination of 

35 these, and then detects a reference frame with the high- 
est correlation in the unit of a macroblock. The refer- 
ence frame with the highest correlation is output from 
the image memory 5015 to the motion compensator 
5016. 

40 [0008] The motion compensator 501 6 outputs a differ- 
ential signal between the video signal of the encoded 
frame and the reproduced video signal of the reference 
frame detected by the motion detector 5014 in the unit 
of a macroblock. A DCT unit 5017 outputs the output 

45 (differential signal) of the motion compensator 5016 as 
DCT coefficients for each block. A quantizer 501 8 quan- 
tizes the DCT coefficients by a quantization step speci- 
fied by an encoding rate controller 5019 and then 
outputs the quantized DCT coefficients. An inverse 

so quantizer 5020 inversely quantizes the DCT coefficients 
quantized at the quantizer 5018 by the quantized quan- 
tization step and then outputs the inversely quantized 
DCT coefficients. An IDCT unit 5012 outputs the output 
of the inverse quantizer 5020 as inverse DCT coeffi- 

55 cients. A motion compensator 5022 generates a repro- 
duced video signal by adding the output of the IDCT unit 
5021 and the reproduced video signal of the reference 
frame whose motion was compensated at the motion 
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compensator 5016, and then stores the reproduced 
video signal in the image memory 5015. A variable- 
length encoder 5023 variable-length encodes the output 
of the quantizer 5018 and a predetermined flag and 
then outputs the variable-length encoded video signal. 5 
A buffer 5024 stores the variable-length encoded video 
signal temporarily and adjusts the output speed of out- 
put data thereof. That is, the buffer 5024 outputs a vari- 
able-length encoded video signal with high resolution. 
[0009] The encoding rate controller 5019 determines 10 
the quantization step of the encoded frame for each 
macroblock, based on the output (differential signal) of 
the motion compensator 5016, the encoded length of 
the encoded video signal, and the residual quantity of 
the buffer 5024. is 
[0010] In such a conventional video signal layering- 
encoding system, however, the two encoding rate con- 
trollers 5007 and 5019 control the encoding quantities 
individually and independently so that the mean bit 
rates of the outputs become constant, respectively. For 20 
that reason, in both the cases where the input video sig- 
nal 5000 contains and does not almost contain a large 
quantity of high frequency component, the encoding 
quantities are controlled in the same manner. More spe- 
cifically, the control for the encoding quantity between 25 
layers is not entirely performed according to the input 
video signal 5000. 

[0011] In addition, although encoding efficiency has 
been improved in encoding a high resolution video sig- 
nal by an increase in the number of reference images 30 
for motion vector detection, an improvement in the 
encoding efficiency by using a low resolution signal 
more effectively has not been performed. 
[001 2] Next, a conventional digital broadcast decoding 
apparatus will be described in reference to FIG. 23, 35 
which illustrates a block diagram of the conventional 
digital broadcast decoding apparatus. 
[0013] The conventional digital broadcast decoding 
apparatus shown in FIG. 23 is a receiver for a digital 
broadcast that employs video and audio signals com- 40 
pressed and encoded by the MPEG standard. 
[0014] As shown in FIG. 23. a demodulating section 
6001 performs a predetermined demodulation on a 
received digital broadcast 6000, thereby generating an 
MPEG stream. A separating section 6002 separates 45 
video and audio signal compressed streams on a pre- 
determined channel from the generated MPEG stream. 
An audio signal decoding section 6003 decodes the 
audio signal compressed stream and outputs an audio 
signal 6020. so 
[0015] In a video signal decoding section 6004, (1) a 
variable-length decoder 6005 variable-length decodes 
the aforementioned video signal compressed stream 
and then outputs the motion vector of a macroblock unit, 
a quantization step (i.e.. a divisor employed in quantiza- 55 
tion), and DOT coefficients, (2) an inverse quantizer 
6006 inversely quantizes the DOT coefficients by the 
quantization step decoded in the unit of a macroblock, 



(3) an IDCT unit 6007 outputs the inversely quantized 
DCT coefficients as IDCT coefficients, (4) a motion 
compensator 6008 reproduces a video signal from the 
IDCT coefficients obtained by employing a motion vec- 
tor in a macroblock unit and also from a signal stored in 
memory 6004, and (5) a memory controller 6010 con- 
trols the storage of the reproduced video signal in the 
memory 6004, the output of the video signal stored in 
the memory 6004 to the motion compensator 6008, and 
the output of the reproduced video signal, thereby out- 
putting a decoded video signal 6021. 
[001 6] Such a conventional digital broadcast decoding 
system reproduces only a video signal present on one 
channel and, therefore, has the disadvantage that a 
broadcasting program on a different channel cannot be 
monitored on a small screen within a main screen at the 
same time. To achieve this, the system can be equipped 
with a plurality of devices of the same structure. But in 
such a case, there is a disadvantage that the cost is sig- 
nificantly increased. 

[0017] Next, a conventional digital broadcasting signal 
storage will be described in reference to FIG. 24, which 
illustrates a block diagram of the conventional digital 
broadcasting signal storage. 

[0018] The conventional digital broadcast storage 
shown in FIG. 24 is a video tape recorder (e.g.. D-VHS) 
for recording a digital broadcast which employs video 
and audio signals compressed and encoded by the 
MPEG standard. 

[0019] As shown in FIG. 24, a demodulating section 
7001 performs a predetermined demodulation on a 
received digital broadcast, thereby generating an 
MPEG stream. A separating section 7002 separates a 
transport stream (TS) on a predetermined channel from 
the MPEG stream. A storing section 7003 stores the 
separated TS in a storage medium 7004. 
[0020] In such a conventional digital broadcasting sig- 
nal storage, storage media are restrained either by a 
large quantity of data to be stored or due to the fast stor- 
ing speed of requisite data. Furthermore, since different 
video signals in various formats (resolution, frame fre- 
quency, etc.) are present in storage media, there is a 
problem that video signals are cfifficutt to handle. 

SUMMARY OF THE INVENTION 

[0021] It is an object of the present invention to pro- 
vide a video signal layering-encoding system and a 
video signal layering-encoding method which are •capa- 
ble of controlling the quantity of encoding between lay- 
ers in accordance with an input video signal. 
[0022] Another object of the invention is to provide a 
digital broadcast decoding system, a digital broadcast 
decoding method, and a video signal decoding system 
which are capable of monitoring a plurality of broadcast- 
ing programs (including a broadcasting program on a 
different channel) by simpler constitution than prior art. 
[0023] Stil I another object of the invention is to provide 
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a digital broadcasting signal storage and a digital broad- 
casting signal storing method which are capable of solv- 
ing, for example, the aforementioned problems that 
storage media are restrained either by a large quantity 
of data to be stored or due to the fast storing speed of 
requisite data and that since different video signals in 
various formats (resolution, frame frequency, etc.) are 
present in storage media, video signals are difficult to 
handle. 

[0024] The first invention of the present invention is a 
method of layering and encoding an input video signal 
on the basis of spatial resolution, comprising: 

a first resolution transformation step of generating a 
second video signal with low resolution from a first 
video signal with high resolution which is said input 
video signal; 

a first encoding step of encoding said second video 
signal; 

a decoding step of decoding the encoded second 
video signal, 

a second resolution transformation step of generat- 
ing a third video signal with the same high resolu- 
tion as said first video signal, based on the decoded 
video signal obtained by decoding said second 
video signal; 

a second encoding step of encoding a video signal 
with the same high resolution as said first video sig- 
nal, obtained based on said first video signal and 
said third video signal; 

a high frequency component information output 
step of outputting information on a high frequency 
component which is included in said first video sig- 
nal or said second video signal; and 
an encoding quantity control step of controlling an 
encoding rate at which said second video signal is 
encoded by said first encoding step and an encod- 
ing rate at which said first video signal is encoded 
by said second encoding step, based on the output 
high frequency component inform a tion. 

[0025] The second invention of the present invention 
is an apparatus for layering and encoding a video signal 
on the basis of spatial resolution, comprising: 

first resolution transformation means to generate a 
second video signal with low resolution from a first 
video signal with high resolution which is an input 
video signal; 

first encoding means to encode said second video 
signal; 

decoding means to decode the encoded second 
video signal; 

second resolution transformation means to gener- 
ate a third video signal with the same resolution as 
said first video signal from the decoded video signal 
of said second video signal; 
second encoding means to encode said first video 
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signal, based on a time axis correlation of the first 
video signal and based on said third video signal as 
a predicted video signal; 

frequency distribution measuring means to meas- 
s ure a frequency distribution of said first video sig- 
nal; and 

encoding quantity control means to control an 
encoding rate at which said second video signal is 
encoded by said first encoding means and an 
10 encoding rate at which said first video signal is 
encoded by said second encoding means, based 
on the measured frequency distribution. 

[0026] With this, for example, by having a frequency 
is distribution judgment unit, encoding quantity control 
according to a frequency component contained in an 
input video signal can be performed between layers. 
[0027] The third invention of the present invention is 
an apparatus for layering and encoding a video signal 
20 on the basis of spatial resolution, comprising: 

first resolution transformation means to generate a 
second video signal with low resolution from a first 
video signal with high resolution which is an input 
25 video signal; 

first encoding means to encode said second video 
signal; 

decoding means to decode the encoded second 
video signal; ' 

30 second resolution transformation means to gener- 
ate a third video signal with the same resolution as 
said first video signal from the decoded video signal 
of said second video signal; 
differential signal generating means to generate a 

35 fourth video signal which is a differential signal 
between said first video signal and said third video 
signal; 

motion detection means to detect motion from said 
first video signal; 
40 second encoding means to encode said fourth 
video signal, based on the detected motion of said 
first video signal; 

frequency distribution measuring means to meas- 
ure a frequency distribution of said first video sig- 
45 nal; and 

encoding quantity control means to control an 
encoding rate at which said second video signal is 
encoded by said first encoding means and an 
encoding rate at which said fourth video signal is 
so encoded by said second encoding means, based 
on the measured frequency distribution. 

[0028] With this, for example, by having a frequency 
distribution judgment unit, encoding quantity control 
ss according to a frequency component contained in an 
input video signal can be performed between layers in 
the hierarchical coding in which an encoded signal at a 
high resolution component is a differential signal with a 
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video signal reproduced from a low resolution compo- 
nent. 

[0029] The fourth invention of the present invention is 
an apparatus for layering and encoding a video signal 
on the basis of spatial resolution, comprising: s 

first resolution transformation means to generate a 
second video signal with low resolution from a first 
video signal with high resolution which is an input 
video signal; 10 
first encoding means to encode said second video 
signal; 

decoding means to decode the encoded second 
video signal; 

second resolution transformation means to gener- 75 
ate a third video signal with the same resolution as 
said first video signal from the decoded video signal 
of said second video signal; 
motion detection means to detect motion from said 
second video signal; 20 
second encoding means to encode said first video 
signal, based on a time axis correlation of the first 
video signal and based on said third video signal as 
a predicted video signal; and 

encoding quantity control means to control an 25 
encoding rate at which said second video signal is 
encoded by said first encoding means and an 
encoding rate at which said first video signal is 
encoded by said second encoding means, based 
on the detected motion of said second video signal. 30 

[0030] The fifth invention of the present invention is an 
apparatus for layering and encoding a video signal on 
the basis of spatial resolution, comprising: 

35 

first resolution transformation means to generate a 
second video signal with low resolution from a first 
video signal with high resolution which is an input 
video signal; 

first encoding means to encode said second video 40 
signal; 

decoding means to decode the encoded second 
video signal; 

second resolution transformation means to gener- 
ate a third video signal with the same resolution as 45 
said first video signal from the decoded video signal 
of said second video signal; 
motion detection means to detect motion from said 
first video signal; 

second encoding means to encode said first video so 
signal, based on a time axis correlation of the first 
video signal and based on said third video signal as 
a predicted video signal; and 
encoding quantity control means to control an 
encoding rate at which said second video signal is ss 
encoded by said first encoding means and an 
encoding rate at which said first video signal is 
encoded by said second encoding means, based 
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on the detected motion of said first video signal. 

[0031 ] With this, for example, by having a motion judg- 
ment unit, encoding quantity control according to the 
motion of an input video signal can be performed 
between layers. 

[0032] The sixth invention of the present invention is 
an apparatus for layering and encoding a video signal 
. on the basis of spatial resolution, comprising: 

first resolution transformation means to generate a 
second video signal with low resolution from a first 
video signal with high resolution which is an input 
video signal; 

first encoding means to encode said second video 
signal; 

decoding means to decode the encoded second 
video signal; 

second resolution transformation means to gener- 
ate a third video signal with the same resolution as 
said first video signal from the decoded video signal 
of said second video signal; 
differential signal generating means to generate a 
fourth video signal which is a differential signal 
between said first video signal and said third video 
signal; 

motion detection means to detect motion from said 
first video signal; 

second encoding means to encode said fourth 
video signal, based on the detected motion of said 
first video signal; and 

encoding quantity control means to control an 
encoding rate at which said second video signal is 
encoded by said first encoding means and an 
encoding rate at which said fourth video signal is 
encoded by said second encoding means, based 
on the detected motion of said first video signal. 

[0033] With this, for example, by having a motion judg- 
ment unit, encoding quantity control according to the 
motion of an input video signal can be performed 
between layers in the hierarchical coding in which an 
encoded signal at a high resolution component is a dif- 
ferential signal with a video signal reproduced from a 
low resolution component. 

[0034] The seventh invention of the present invention 
is an apparatus for layering and encoding a video signal 
on the basis of spatial resolution, comprising: 

first resolution transformation means to generate a 
second video signal with low resolution from a first 
video signal with high resolution which is an input 
video signal; 

first encoding means to encode said second video 
signal; 

decoding means to decode the encoded second 
video signal; 

second resolution transformation means to gener- 
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ate a third video signal with the same resolution as 
said first video signal from the decoded video signal 
of said second video signal; 
motion detection means to detect motion from said 
second video signal; 

second encoding means to encode said first video 
signal, based on a time axis correlation of the first 
video signal and based on said third video signal as 
a predicted video signal; 

frequency distribution measuring means to meas- 
ure a frequency distribution of said first video sig- 
nal; and 

encoding quantity control means to control an 
encoding rate at which said second video signal is 
encoded by said first encoding means and an 
encoding rate at which said first video signal is 
encoded by said second encoding means, based 
on the detected frequency distribution and the 
detected motion of said second video signal. 

[0035] The eighth invention of the present invention is 
an apparatus for layering and encoding a video signal 
on the basis of spatial resolution, comprising: 

first resolution transformation means to generate a 
second video signal with low resolution from a first 
video signal with high resolution which is an input 
video signal; 

first encoding means to encode said second video 
signal; 

decoding means to decode the encoded second 
video signal; 

second resolution transformation means to gener- 
ate a third video signal with the same resolution as 
said first video signal from the decoded video signal 
of said second video signal; 
motion detection means to detect motion from said 
first video signal; 

second encoding means to encode said first video 
signal, based on a time axis correlation of the first 
video signal and based on said third video signal as 
a predicted video signal ; 

frequency distribution measuring means to meas- 
ure a frequency distribution of said first video sig- 
nal; and 

encoding quantity control means to control an 
encoding rate at which said second video signal is 
encoded by said first encoding means and an 
encoding rate at which said first video signal is 
encoded by said second encoding means, based 
on the detected frequency distribution and the 
detected motion of said first video signal. 

[0036] With this, for example, by having a frequency 
distribution judgment unit, encoding quantity control 
according to a frequency component contained in an 
input video signal can be performed between layers, 
and by having a motion judgment unit, encoding quan- 



tity control according to the motion of an input video sig- 
nal can be performed between layers. 
[0037] The ninth invention of the present invention is 
an apparatus for layering and encoding a video signal 
s on the basis of spatial resolution, comprising: 

first resolution transformation means to generate a 
second video signal with low resolution from a first 
video signal with high resolution which is an input 
io video signal; 

first encoding means to encode said second video 
signal; 

decoding means to decode the encoded second 
video signal; 

is second resolution transformation means to gener- 
ate a third video signal with the same resolution as 
said first video signal from the decoded video signal 
of said second video signal; 
differential signal generating means to generate a 

so fourth video signal which is a differential signal 
between said first video signal and said third video 
signal; 

motion detection means to detect motion from said 
first video signal; 
25 second encoding means to encode said fourth 
video signal, based on the detected motion of said 
first video signal; 

frequency distribution measuring means to meas- 
ure a frequency distribution of said first video sig- 

30 nal;and 

encoding quantity control means to control an 
encoding rate at which said second video signal is 
encoded by said first encoding means and an 
encoding rate at which said fourth video signal is 

35 encoded by said second encoding means, based 
on the measured frequency distribution and the 
detected motion of said first video signal. 

[0038] With this, for example, by having a frequency 
40 distribution judgment unit, encoding quantity control 
according to a frequency component contained in an 
input video signal can be performed between layers in 
the hierarchical coding in which an encoded signal at a 
high resolution component is a differential signal with a 
45 video signal reproduced from a low resolution compo- 
nent, and by having a motion judgment unit, encoding 
quantity control according to the motion of an input 
video signal can be performed between layers in the 
hierarchical coding in which an encoded signal at a high 
so resolution component is a differential signal with a video 
signal reproduced from a low resolution component. 
[0039] The seventeenth invention of the present 
invention is a method of layering and encoding an input 
video signal on the basis of spatial resolution, compris- 
es ing: 

a first resolution transformation step of generating a 
second video signal with low resolution from a first 
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video signal with high resolution which is said input 
video signal; 

a first encoding step of encoding said second video 
signal; 

a decoding step of decoding the encoded second 
video signal; 

a second resolution transformation step of generat- 
ing a third video signal with the same high resolu- 
tion as said first video signal, based on the decoded 
video signal obtained by decoding said second 
video signal; and 

a second encoding step of encoding said first video 
signal, based on a plurality of encode modes; 
wherein, when in said second encoding step said 
encoding is performed by employing an encode 
mode based on bidirectional prediction in a time 
axis direction among said plurality of encode 
modes, only information indicating which of said 
first video signal or said decoded video signal is uti- 
lized by the encoding in said first encoding step or 
encoding in said second encoding step is encoded. 

[0040] The eighteenth invention of the present inven- 
tion is an apparatus for layering and encoding a video 
signal on the basis of spatial resolution, comprising: 

first resolution transformation means to generate a 
second video signal with low resolution from a first 
video signal with high resolution which is an input 
video signal; 

first encoding means to encode said second video 
signal; 

decoding means to decode the encoded second 
video signal; 

second resolution transformation means to gener- 
ate a third video signal with the same resolution as 
said first video signal from the decoded video signal 
of said second video signal; and 
second encoding means to encode each frame of 
said first video signal by at least one of the encode 
modes among (1) spatial inter-resolution predictive 
coding which employs prediction in a spatial axis 
direction employing said third video signal, (2) intra- 
frame coding which employs only data within said 
frame, (3) interframe forward predictive coding 
which employs forward prediction in a time axis 
direction, and (4) interframe bidirectional predictive 
coding which employs bidirectional prediction in the 
time axis direction; 

wherein, when said interframe bidirectional predic- 
tive coding is performed by said second encoding 
means, only a motion vector obtained by interframe 
bidirectional prediction is encoded. 

[0041] With this, for example, by encoding only a 
motion vector based on bidirectional prediction between 
frames, a reduction in the quantity of encoding becomes 
possible, so the encoding efficiency of high resolution 
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signals can be enhanced. 

[0042] The nineteenth invention of the present inven- 
tion is an apparatus for layering and encoding a video 
signal on the basis of spatial resolution, comprising: 

5 

first resolution transformation means to generate a 
second video signal with low resolution from a first 
video signal with high resolution which is an input 
video signal; 

w first encoding means to encode each frame of said 
second video signal by either (1) intraframe coding 
which employs only data within said frame, (2) inter- 
frame forward predictive coding which employs for- 
ward prediction in a time axis direction, or (3) 
is interframe bidirectional predictive coding which 
employs bidirectional prediction in the time axis 
direction; 

decoding means to decode the encoded second 
video signal; 

second resolution transformation means to gener- 
ate a third video signal with the same resolution as 
said first video signal from the decoded video signal 
of said second video signal; and 
second encoding means to encode each frame of 
said first video signal by at least one of the encode 
modes among (1) spatial inter-resolution predictive 
coding which employs prediction in a spatial axis 
direction employing said third video signal, (2) intra- 
frame coding which employs only data within said 
frame, (3) interframe forward predictive coding 
which employs forward prediction in a time axis 
direction, and (4) interframe bidirectional predictive 
coding which employs bidirectional prediction in the 
time axis direction; 

wherein, when said interframe bidirectional predic- 
tive coding is performed by said second encoding 
means, only a motion vector obtained by interframe 
bidirectional prediction is encoded. 

[0043] With this, for example, in addition to the afore- 
mentioned advantages, the encoded type of each frame 
becomes the same in encoding a low resolution signal 
and a high resolution signal, so it becomes possible to 
apply the motion vector of a low resolution signal when 
a high resolution signal is decoded, and consequently, 
error tolerance is increased. 

[0044] The twenty-fifth invention of the present inven- 
tion is an apparatus for layering and encoding a video 
signal on the basis of spatial resolution, comprising: 

first resolution transformation means to generate a 
second video signal with low resolution from a first 
video signal with high resolution which is an input 
video signal; 

first encoding means to encode said second video 
signal; 

decoding means to decode the encoded second 
video signal; 
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second resolution transformation means to gener- 
ate a third video signal with the same resolution as 
said first video signal from the decoded video signal 
of said second video signal; and 
second encoding means to encode each frame of 
said first video signal by at least one of the encode 
modes among (1) spatial inter-resolution predictive 
coding which employs prediction in a spatial axis 
direction employing said third video signal, (2) intra- 
frame coding which employs only data within said 
frame, (3) interframe forward predictive coding 
which employs forward prediction in a time axis 
direction, and (4) interframe bidirectional predictive 
coding which employs bidirectional prediction in the 
time axis direction; 

wherein said second encoding means encodes 
frames of said first video signal at intervals of a pre- 
determined number of frames by said spatial inter- 
resolution predictive coding alone. 

[0045] With this, for example, intraframe coding is not 
performed on high resolution signals, so a reduction in 
the quantity of encoding becomes possible, so that the 
encoding efficiency of high resolution signals can be 
enhanced. 

[0046] The twenty-sixth invention of the present inven- 
tion is an apparatus for layering and encoding a video 
signal on the basis of spatial resolution, comprising: 

first resolution transformation means to generate a 
second video signal with low resolution from a first 
video signal with high resolution which is an input 
video signal; 

first encoding means to encode said second video 
signal; 

decoding means to decode the encoded second 
video signal; 

second resolution transformation means to gener- 
ate a third video signal with the same resolution as 
said first video signal from the decoded video signal 
of said second video signal; 
second encoding means to encode each frame of 
said first video signal by at least one of the encode 
modes among (1) spatial inter-resolution predictive 



employing a motion vector obtained by multiplying 
the motion vector detected at said motion vector 
detection means by a predetermined number. 

s [0047] With this, for example, as the motion vector 
detection of the frame of a high resolution signal is not 
performed, overall circuit size can be reduced, and as 
the motion vector is not encoded, the encoding effi- 
ciency of high resolution signals can be enhanced. 

10 [0048] The twenty-eighth invention of the present 
invention is a method of layering and encoding an input 
video signal on the basis of spatial resolution, compris- 
ing: 

is a first resolution transformation step of generating a 
second video signal with low resolution from a first 
video signal with high resolution which is said input 
video signal; 

a first encoding step of encoding said second video 
so signal; 

a decoding step of decoding the encoded second 
video signal; 

a second resolution transformation step of generat- 
ing a third video signal with the same high resolu- 
25 tion as said first video signal, based on the decoded 
video signal obtained by decoding said second 
video signal; 

a differential signal generation step of computing a 
data difference between frames of said first and 
30 third video signals which correspond with each 
other and generating a differential signal; 
a band dividing step of dividing the generated differ- 
ential signal into a plurality of predetermined bands 
and generating a band dividing signal; and 
35 a second encoding step of encoding the generated 
band dividing signal. 

[0049] The twenty-ninth of the present invention is an 
apparatus for layering and encoding an input video sig- 
40 nal on the basis of spatial resolution, comprising: 

first resolution transformation means to generate a 
second video signal with low resolution from a first 
video signal with high resolution which is said input 
video signal; 

first encoding means to encode said second video 
signal; 

decoding means to decode the encoded second 
video signal; 

second resolution transformation means to gener- 
ate a third video signal with the same high resolu- 
tion as said first video signal, based on the decoded 
video signal obtained by decoding said second 
video signal; 

differential signal generation means to compute a 
data difference between frames of said first and 
third video signals which correspond with each 
other and generate a differential signal; 



coding which employs prediction in a spatial axis 45 
direction employing said third video signal, (2) intra- 
frame coding which employs only data within said 
frame, (3) interframe forward predictive coding 
which employs forward prediction in a time axis 
direction, and (4) interframe bidirectional predictive so 
coding which employs bidirectional prediction in the 
time axis direction; and 

motion vector detection means to detect a motion 
vector between frames of said first video signal; 
wherein said second encoding means performs ss 
encoding by employing the motion vector detected 
by said motion vector detection means, and said 
first encoding means performs encoding by 
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band dividing means to divide the generated differ- 
ential signal by said differential signal generation 
means into a plurality of predetermined bands and 
generate a band dividing signal; and 
second encoding means to encode said band divid- 
ing signal generated by said band dividing means. 

[0050] With this, for example, different encoding meth- 
ods are employed in a low resolution signal and a high 
resolution signal, so if both signals are combined 
together, a high resolution signal can be encoded so 
that it is effective and therefore the picture quality of a 
high resolution signal can be improved. 
[0051 ] The thirtieth invention of the present invention 
is a digital broadcast decoding method of decoding a 
broadcasting signal compressed by the Moving Picture 
Experts Group (MPEG) standard and multiplexed, com- 
prising: 

a demodulation step of performing a predetermined 
demodulation on said broadcasting signal; 
a separation step of separating the demodulated 
broadcasting signal into a video signal compressed 
stream and an audio signal compressed stream on 
a first channel; 

a first video signal decoding step of decoding the 
separated video signal compressed stream present 
on said first channel; 

a first audio signal decoding step of decoding the 
separated audio signal compressed stream present 
on said first channel; and 

a second video signal decoding step of decoding a 
video signal compressed stream present on a sec- 
ond channel different from said first channel; 
wherein in said second video signal decoding step, 
(1) the video signal compressed stream on said 
second channel is decoded, (2) a motion vector, 
and a DC component in DOT coefficients are 
extracted, or a DC component and some of DCT 
coefficients excluding the DC component are 
extracted, and (3) based on the extracted contents, 
said second video signal is decoded. 

10052] The thirty-first invention of the present inven- 
tion is a digital broadcast decoding apparatus for decod- 
ing a broadcasting siganal which is generated from a 
video signal and an audio signal which are compressed 
by the Moving Picture Experts Group (MPEG) standard, 
multiplexed and modulated, comprising: 

a demodulating section to perform a predetermined 
demodulation on said digital broadcasting signal; 
a separating section to separate the demodulated 
broadcasting signal into a video signal compressed 
stream and an audio signal compressed stream on 
at least one channel by releasing said multiplexing; 
a first video signal decoding section to decode the 
separated video signal compressed stream present 



on a predetermined channel; 
an audio signal decoding section to decode the 
separated audio signal compressed stream present 
on said predetermined channel; 
a second video signal decoding section to decode a 
video signal compressed stream present on a 
channel other than said predetermined channel 
and to output the decoded signal; and 
a video signal overlaying section to overlay a video 
signal output of said second video signal decoding 
section at a predetermined position on a video sig- 
nal output of said first video signal decoding section 
and to output the overlaid signal; 
wherein said second video signal decoding section 
has: 

a variable-length decoder which (1) variable-length 
decodes said video signal compressed stream, (2) 
extracts a motion vector and a DC component, or 
(3) extracts a quantization step when said DC com- 
ponent is quantized, the quantization step being a 
divisor employed in the quantization; 
inverse cfifferential pulse code modulation (DPCM) 
unit to perform inverse DPCM only when DPCM 
has been performed on said DC corrponent; 
an inverse quantizer to perform inverse quantiza- 
tion only when said DC corrponent has been quan- 
tized; 

memory to store the decoded video signal; 
a motion compensator to compensate motion by 
employing both a video signal compensated and 
decoded after said motion vector has been trans- 
formed by a predetermined transformation and a 
video signal stored in said memory; and 
a memory controller to control writing of data to Said 
memory and reading of data from said memory. 

[0053] With this, for example, a broadcasting program 
on a different channel can be readily displayed on a 
small screen within a main screen when a digital broad- 
cast is received. 

[0054] The thirty-third invention of the present inven- 
tion is a digital broadcast decoding apparatus for decod- 
ing a broadcasting siganal which is generated from a 
video signal and an audio signal which are compressed 
by the Moving Picture Experts Group (MPEG) standard, 
multiplexed and modulated, comprising: 

a demodulating section to perform a predetermined 
demodulation on said digital broadcasting signal; 
a separating section to separate the demodulated 
broadcasting signal into a video signal compressed 
stream and an audio signal compressed stream on 
at least one channel by releasing said multiplexing; 
a first video signal decoding section to decode the 
separated video signal compressed stream present 
on a predetermined channel; 
an audio signal decoding section to decode the 
separated audio signal compressed stream present 
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on said predetermined channel; 
a second video signal decoding section to decode a 
video signal compressed stream present on a 
channel other than said predetermined channel 
and to output the decoded signal; and s 
a video signal overlaying section to overlay a video 
signal output of said second video signal decoding 
section at a predetermined position on a video sig- 
nal output of said first video signal decoding section 
and to output the overlaid signal ; w 
wherein said second video signal decoding section 
has: 

a variable-length decoder which (1) variable-length 
decodes said video signal compressed stream and 
(2) extracts a motion vector, a quantization step 75 
which is a divisor employed in quantization, and M 
x N DCT coefficients consisting of M coefficients in 
a horizontal direction (where M is a natural number 
from 1 to 8) and N coefficients in a vertical direction 
(where N is a natural number from 1 to 8); 20 
an 4«veree<quantirer^o quantize said M x N DCT 
coefficients inversely; 

memory to store the decoded video signal; 
a motion compensator to compensate motion by 
employing both a video signal compensated and 2s 
decoded after said motion vector has been trans- 
formed in horizontal and vertical directions by a pre- 
determined transformation and a video signal 
stored in said memory; and 

a memory controller to control writing of data to said 30 
memory and reading of data from said memory. 

[0055] With this, for example, a broadcasting program 
on a different channel can be readily displayed on a 
small screen within a main screen when a digital broad- 35 
cast is received. 

[0056] The fortieth invention of the present invention 
is a digital broadcasting signal storing method of receiv- 
ing and storing a broadcasting signal compressed by 
the Moving Picture Experts Group (MPEG) standard 40 
and multiplexed, comprising the steps of: 

receiving said broadcasting signal and performing a 
predetermined demodulation; 

separating a video signal compressed stream from 45 

the demodulated broadcasting signal; 

decoding the separated video signal compressed 

stream; 

based on a predetermined flag in the decoded 
stream, and/or based on a predetermined motion so 
vector and predetermined DCT coefficients in the 
decoded stream, (1) converting various formats in 
said decoded stream to a predetermined format, 
and/or (2) reducing the data amount of said 
decoded stream, and then (3) encoding said 55 
decoded stream; and 

storing the encoded stream in a predetermined 
storage medium. 



[0057] The forty-first invention of the present invention 
is a digital broadcasting signal storage for storing a 
broadcast compressed by the Moving Picture Experts 
Group (MPEG) standard, comprising: 

a demodulating section to perform a predetermined 
demodulation on a digital broadcast which is broad- 
casted by compressing a video signal and an audio 
signal by the MPEG standard and performing pre- 
determined multiplexing and modulation on the 
video and audio signals; 

a separating section to separate video and audio 
signal compressed streams on a predetermined 
channel by releasing said predetermined multiplex- 
ing; 

memory to store the separated audio signal com- 
pressed stream temporarily; 
a variable-length decoder to perform variable- 
length decoding on the separated video signal com- 
pressed stream and to select various flags, motion 
vectors, and a predetermined number of DCT coef- 
ficients (M coefficients in a horizontal direction 
where M is a natural number from 1 to 8 and N coef- 
ficients in a vertical direction where N is a natural 
number from 1 to 8); 

a variable-length encoder to perform variable- 
length encoding on the selected various flags and 
motion vectors, by performing a predetermined flag 
transformation on the selected various flags and 
also performing a motion vector transformation on 
the selected motion vectors; 
a multiplexing section to multiplex the variable- 
length encoded video signal data and said audio 
signal compressed stream; and 
a storage section to store the multiplexed data in a 
predetermined storage medium. 

[0058] With this, for example, either by thinning out 
DCT coefficients to reduce the quantity of data to be 
stored or to slow down the storing speed of requisite 
data, or by encoding DCT coefficients again, even in the 
case where video signals in various formats (resolution, 
frame frequency, etc.) are input, the video signals can 
be stored in a storage medium as a single format. 
[0059] The forty-second invention of the present 
invention is a digital broadcasting signal storage for 
storing a broadcast compressed by the Moving Picture 
Experts Group (MPEG) standard, comprising: 

a demodulating section to perform a predetermined 
demodulation on a digital broadcast which is broad- 
casted by compressing a video signal and an audio 
signal by the MPEG standard and performing pre- 
determined multiplexing and modulation on the 
video and audio signals; 

a separating section to separate video and audio 
signal compressed streams on a predetermined 
channel by releasing said predetermined murtiplex- 
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ing; 

memory to store the separated audio signal com- 
pressed stream temporarily; 
a variable-length decoder which variable-length 
decodes the separated video signal compressed s 
stream and selects various flags, (1) performs a 
motion vector transformation when a motion vector 
has been determined in a frame unit, (2) converts 
the motion vector to a frame unit by a predeter- 
mined approximation method when the motion vec- io 
tor has been determined in a field unit, (3) selects 
only a predetermined number of DCT coefficients 
(M coefficients in a horizontal direction and N coef- 
ficients in a vertical direction where M and N are a 
natural number from 1 to 8) when DCT coefficients is 
have been determined in a frame unit, and (4) 
deletes one group of DCT coefficients and selects 
only a predetermined number of DCT coefficients 
(M coefficients in a horizontal direction and K coef- 
ficients in a vertical direction where M and K are a 20 
natural number from 1 to 8) when DCT coefficients 
have been determined in a field unit; 
a variable-length encoder to perform variable- 
length encoding on the selected various flags, 
motion vectors, and DCT coefficients by performing 25 
a predetermined flag transformation on the 
selected various flags, motion vectors, and DCT 
coefficients; 

a multiplexing section to multiplex the variable- 
length encoded video signal data and said audio 30 
signal compressed stream; and 
a storage section to store the multiplexed data in a 
predetermined storage medium. 

[0060] With this, for example, either by thinning out 35 
DCT coefficients to reduce the quantity of data to be 
stored or to slow down the storing speed of requisite 
data, or by encoding DCT coefficients again, even in the 
case where video signals in various formats (resolution, 
frame frequency, etc.) are input, the video signals can 40 
be stored in a storage medium as a single format. 
[0061] The forty-third invention of the present inven- 
tion is an apparatus for reproducing a video signal and 
an audio signal, comprising: 

45 

a reproducing section to reproduce data stored in 
the digital broadcasting signal storage as set forth 
in said forty-first or said forty-second invention; 
a separating section to separate the reproduced 
data into video and audio signal compressed so 
streams; 

a video signal decoding section to decode the sep- 
arated video signal compressed stream; and 
an audio signal decoding section to decode the 
separated audio signal compressed stream; 55 
wherein the video signal decoding section has: 
a variable-length decoder to perform variable- 
length decoding on said video signal compressed 



stream; 

an inverse quantizer to quantize the variable-length 
decoded data inversely; 

an IDCT unit to perform an inverse M x N or M x K 
DCT (where M, N, and K are a natural number from 
1 to 8) on the inversely quantized data; 
memory to store the decoded video signal; 
a motion compensator to compensate motion by 
employing both a video signal decoded with a 
motion vector and a video signal stored in said 
memory; and 

a memory controller to control writing of data to said 
memory and reading of data from said memory. 

[0062] With this, for example, by thinning out DCT 
coefficients, the quantity of data to be stored can be 
reduced and the speed of requisite data can be slowed 
down. 

[0063] The forty-fourth invention of the present inven- 
tion is a digital broadcasting signal storage for storing a 
broadcast compressed by the Moving Picture Experts 
Group (MPEG) standard, comprising: 

a demodulating section to perform a predetermined 
demodulation on a digital broadcast which is broad- 
casted by compressing a video signal and an audio 
signal by the MPEG standard and performing pre- 
determined multiplexing and modulation on the 
video and audio signals; 

a separating section to separate video and audio 
signal compressed streams on a predetermined 
channel by releasing said predetermined multiplex- 
ing; 

memory to store the separated audio signal com- 
pressed stream temporarily; 
a video signal decoding section to decode the sep- 
arated video signal compressed stream; 
a video signal compression section to compress a 
video signal which is the output of said video signal 
decoding section; 

a multiplexing section to multiplex the video signal 
compressed stream compressed at said video sig- 
nal compression section and said audio signal com- 
pressed stream; and 

a storage section to store the multiplexed data in a 
predetermined storage medium; 
wherein said video signal decoding section has: 
a variable-length decoder to perform variable- 
length decoding on said video signal compressed 
stream; 

an inverse quantizer to quantize the variable-length 
decoded data inversely; 

an IDCT unit to perform an inverse DCT on the 

inversely quantized data; 

memory to store the decoded video signal; 

a motion compensator to compensate motion by 

employing both a video signal decoded with a 

motion vector and a video signal stored in said 
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memory; and 

a memory controller to control writing of data to said 
memory and reading of data from said memory; 
and 

wherein said video signal compression section has: s 
a filtering unit to change resolution of a video signal 
by performing a predetermined filtering operation 
on a reproduced video signal of a video signal com- 
pressed stream during a digital broadcast, the 
reproduced video signal being the output of the 
video signal decoding section; 
a differential signal generator to generate a differ- 
ential signal of the filtered reproduced video signal 
by employing said motion vector present in said 
video signal compressed stream which is the output 
of said video signal decoding section; 
a DCT unit to perform DOT on the differential sig- 
nal; 

a quantizer to quantize data after DCT by employ- 
ing said various flags which are input to the quan- 
tizer; a variable-length encoder to variable-length 
encode the output of said quantizer; and said video 
signal compression section outputs a new video 
signal compressed stream. 

[0064] With this, for example, either by thinning out 
DCT coefficients to reduce the quantity of data to be 
stored or to slow down the storing speed of requisite 
data, or by encoding DCT coefficients again, even in the 
case where video signals in various formats (resolution, 
frame frequency, etc.) are input, the video signals can 
be stored in a storage medium as a single format. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0065] The above and other objects and advantages 
will become apparent from the following detailed 
description when read in conjunction with the accompa- 
nying drawings wherein: 

FIG. 1 is a block diagram of a video signal layering- 
encoding apparatus (system) according to a first 
embodiment of the present invention ; 
FIG. 2 is a block diagram of a video signal layering- 
encoding apparatus (system) according to a sec- 
ond embodiment of the present invention; 
FIG. 3 is a block diagram of a video signal layering- 
encoding apparatus(system) according to a third 
embodiment of the present invention; 
FIG. 4 is a block diagram of a video signal layering- 
encoding apparatus (system) according to a fourth 
embodiment of the present invention; 
FIG. 5 is a block diagram of a video signal layering- 
encoding apparatus (system) according to a fifth 
embodiment of the present invention; 
FIG. 6 is a block diagram of a video signal layering- 
encoding apparatus(system) according to a sixth 
embodiment of the present invention; 



FIG. 7 is a block diagram of a video signal layering- 
encoding apparatus(system) according to a sev- 
enth embodiment of the present invention; 
FIG. 8 is a block diagram of a video signal layering- 
encoding apparatus (system) according to an 
eighth embodiment of the present invention and a 
ninth embodiment of the present invention; 
FIG. 9 is a block diagram of a video signal layer ing- 
encoding apparatus(system) according to a 13th 
embodiment of the present invention; 
FIG. 10 is a block diagram of a video signal layer- 
ing-encoding apparatus(system) according to an 
14th embodiment of the present invention; 
FIG. 1 1 is a block diagram of a first digital broadcast 
decoding apparatus(system) according to a 15th 
embodiment of the present invention; 
FIG. 1 2 is a block diagram of a first digital broadcast 
decoding apparatus(system) according to a 16th 
embodiment of the present invention; 
FIG. 13 is a block diagram of a second digital 
broadcast decoding apparatus(system) according 
to a 17th embodiment of the present invention; 
FIG. 14 is a block diagram of a second digital 
broadcast decoding apparatus(system) according 
to a 18th embodiment of the present invention; 
FIG. 15 is a flowchart of a video signal decoding 
system according to the 15th embodiment of the 
present invention; , 

FIG. 16 is a flowchart of a video signal decoding 
system according to the 16th embodiment of the 
present invention; 

FIG. 17 is a block diagram of a digital broadcasting 
signal storage according to a 19th and a twentieth 
embodiments of the present invention; 
FIG. 18 is a block diagram of the variable-length 
decoding section and variable-length encoding sec- 
tion of the 19th embodiment of the present inven- 
tion; 

FIG. 19 is a block diagram of a variable-length 
decoding section and a variable-length encoding 
section according to the twentieth embodiment of 
the present invention; 

FIG. 20 is a block diagram of a video signal repro- 
ducing apparatus (system) according to a twenty- 
first embodiment of the present invention; 
FIG. 21 is a block diagram of a digital broadcasting 
signal storage according to a twenty-second 
embodiment of the present invention; 
FIG. 22 is a block diagram of a conventional video 
signal layering-encoding apparatus(system); 
FIG. 23 is a block diagram of a conventional digital 
broadcast decoding apparatus(system); and 
FIG. 24 is a block diagram of a conventional digital 
broadcasting signal storage. 
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DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

[0066] Embodiments of the present invention will 
hereinafter be described in reference to the drawings. 

(First Embodiment) 

[0067] For a video signal layer ing-encoding appara- 
tus(system) according to a first embodiment of the 
present invention, a description will be made of the con- 
stitution and operation in reference to FIG. 1. FIG. 1 
illustrates a block diagram of the video signal layering- 
encoding system of this embodiment. 
[0068] In the figure, 101 is a resolution converter, 102 
a frequency distribution measuring unit, 103 a motion 
detector, 104 image memory, 105 a motion compensa- 
tor, 106 a DCT unit 107 a quantizer, 108 an encoding 
rate controller, 109 an inverse quantizer, 110 an I DCT 
unit, 111a motion compensator, 112 a variable-length 
encoder, 113 a buffer, 114 a resolution converter, 115 a 
motion detector, 1 16 image memory, 117 a motion com- 
pensator, 118 a DCT unit 119 a quantizer, 120 an 
encoding rate controller, 121 an inverse quantizer, 122 
an IDCT unit, 123 a motion compensator, 124 a varia- 
ble-length encoder, and 1 25 a buffer. 
[0069] The main constitutional feature of this embodi- 
ment resides in that it is equipped with the frequency 
distribution measuring unit 102 and that the encoding 
rate controller 108 sends to the encoding rate controller 
120 a predetermined control signal. 
[0070] In this embodiment the frequency distribution 
measuring unit 102 employs a high-pass filter having a 
passband higher than a frequency limited by the resolu- 
tion converter 101 . When the quantity of the output (sig- 
nal component) of this high-pass filter is less than a 
predetermined value, i.e., in the case where the quantity 
of the high frequency component contained in the out- 
put signal is small, the encoding rate controller 108 is 
constructed so that it increases the rate at which a low 
resolution video signal is encoded. In general, if there is 
a large quantity of motion between frames, an image 
itself will become ambiguous, and therefore, the quan- 
tity of the high frequency component contained in the 
frame will be reduced. 

{0071] In the aforementioned constitution, the opera- 
tion of the video signal layering-encoding system of this 
embodiment will next be described, and a description 
will be made of an embodiment of a video signal layer- 
ing-encoding method according to the present inven- 
tion. 

[0072] An input video signal 100 is converted to a 
lower resolution video signal than the input video signal 
100 by the resolution converter 101 . 
[0073] The frequency distribution measuring unit 102 
measures and outputs how much the high frequency 
component that is not contained in the low resolution 
video signal converted by the resolution converter 101 



is contained in the input video signal 100. 
[0074] The motion detector 103 stores the output of 
the resolution converter 101 (the encoded frame of the 
input video signal 100) in the image memory 104 and 
s also detects the motion of a macroblock unit from the 
encoded frame and the previously encoded and 
decoded past reference frame in the image memory 
104. 

[0075] The motion compensator 105 outputs a differ- 
to ential signal between the video signal of the encoded 
frame and the reproduced video signal of the reference 
frame detected by the motion detector 103 in the unit of 
a macroblock. 

[0076] The discrete cosine transform (DCT) unit 106 
is outputs the output (differential signal) of the motion 
compensator 1 05 as DCT coefficients for each block. 
[0077] The quantizer 107 quantizes the DCT coeffi- 
cients by a quantization step specified by the encoding 
rate controller 108 and then outputs the quantized DCT 
20 coefficients. 

[0078] The inverse quantizer 1 09 inversely quantizes 
the DCT coefficients quantized at the quantizer 107 by 
the quantized quantization step and then outputs the 
inversely quantized DCT coefficients. 
25 [0079] The inverse DCT (IDCT) unit 110 outputs the 
output of the inverse quantizer 109 as inverse DCT 
coefficients. 

[0080] The motion compensator 1 1 1 generates a 

reproduced video signal by adding the output of the 
30 IDCT unit 110 and the video signal of the reference 

frame whose motion was compensated at the motion 

compensator 105, and then stores the reproduced 

video signal in the image memory 104. 

[0081] The variable-length encoder 112 variable- 
35 length encodes the output of the quantizer 107 and a 

predetermined flag and then outputs the variable-length 

encoded video signal. 

[0082] The buffer 113 stores the variable-length 
encoded video signal temporarily and adjusts the output 
40 speed of output data thereof. That is, the buffer 1 1 3 out- 
puts a variable-length encoded video signal with low 
resolution. 

[0083] The encoding rate controller 108 determines 
the quantization step of the encoded frame for -each 

45 macroblock, based on the output of the frequency distri- 
bution measuring unit 102, the output {differential sig- 
nal) of the motion <x>mpensator 105, the encoded length 
of the encoded video signal, and the residual quantity 
information on the buffer 1 13. 

so [0084] That is, when the quantity of the high frequency 
component contained in the output signal of the fre- 
quency distribution measuring unit 102 is small, the 
encoding rate controller 108 increases the encoding 
rate at which a low resolution video signal is encoded, in 

55 comparison with the case where the quantity of the high 
frequency component is large. Furthermore, the encod- 
ing rate controller 108 sends the encoding rate informa- 
tion on a low resolution video signal to the encoding rate 
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controller 120. 

[0085] On the other hand, the resolution converter 1 1 4 
resolution converts the output (reproduced video signal) 
of the motion compensator 111, i.e., converts the reso- 
lution of the reproduced video signal to the same reso- s 
lution as the input video signal 100 and then stores it in 
the image memory 1 16. 

[0086] The motion detector 115 stores the encoded 
frame of the input video signal 100 in the image memory 
116 and also detects the motion of a macroblock unit w 
from the encoded frame, the previously encoded and 
decoded past reference frame in the image memory 
116, and from the reference frame that is the video sig- 
nal of the same time among the low resolution signals 
which are the outputs of the resolution converter 114. 15 
[0087] That is, in this motion detection, the motion 
detector 115 compares the encoded frame of the input 
video signal 100 with the above-mentioned past refer- 
ence frame, the above-mentioned reference frame of 
the same time, and a reference frame generated by a so 
co i i Iw l aliui 1 "of "these, and then detects a reference 
frame with the highest correlation in the unit of a mac- 
roblock. The reference frame with the highest correla- 
tion is output from the image memory 1 1 6 to the motion 
compensator 117. 25 
[0088] As previously described, generally if there is a 
large quantity of motion between frames, an image itself 
will become ambiguous, and therefore, the quantity of 
the high frequency component contained in the frame 
will be reduced. Therefore, when the quantity of motion 30 
is large, the correlation between the encoded frame and 
the reference frame of the same time becomes higher, 
and therefore, the reference frame of the same time is 
output from the image memory 1 16 to the motion com- 
pensator 117. 35 
[0089] The motion compensator 1 1 7 outputs a differ- 
ential signal between the video signal of the encoded 
frame and the reproduced video signal of the reference 
frame detected by the motion detector 1 15 in the unit of 
a macfobJoGk. 40 
[0090] Therefore, in the case of a large quantity of 
motion as in the above-mentioned, the quantity of the 
differential signal output by the motion compensator 117 
is reduced. This means that in the case where the quan- 
tity of the high frequency component contained in the 45 
input signal 100 is small, the encoding rate controller 
1 20 wil{ have little influence on picture quality even if the 
rate at which a high resolution video signal is encoded 
is reduced. This point will be described in further detail 
later. so 
[0091 ] The DCT unit 1 1 8 outputs the output (differen- 
tial signal) of the motion compensator 1 1 7 as DCT coef- 
ficients for each block. 

[0092] The quantizer 119 quantizes the DCT coeffi- 
cients by a quantization step specified by the encoding 55 
rate controller 120 and then outputs the quantized DCT 
coefficients. 

[0093] An inverse quantizer 121 inversely quantizes 



the DCT coefficients quantized at the quantizer 1 19 by 
the quantized quantization step and then outputs the 
inversely quantized DCT coefficients. 
[0094] The IDCT unit 122 outputs the output of the 
inverse quantizer 121 as inverse DCT coefficients. 
[0095] The motion compensator 123 generates a 
reproduced video signal by adding the output of the 
IDCT unit 122 and the reproduced video signal of the 
reference frame whose motion was compensated at the 
motion compensator 117, and then stores the repro- 
duced video signal in the image memory 1 16. 
[0096] The variable-length encoder 124 variable- 
length encodes the output of the quantizer 119 and a 
predetermined flag and then outputs the variable-length 
encoded video signal. 

[0097] The buffer 125 stores the variable-length 
encoded video signal temporarily and adjusts the output 
speed of output data thereof. That is, the buffer 125 out- 
puts a variable-length encoded video signal with high 
resolution. 

[0098] The encoding rate controller 120 determines 
the quantization step of the encoded frame for each 
macroblock, based on the encoded state of the low res- 
olution signal estimated at the encoding rate controller 
108 (i.e., the value of an encoding rate, etc.), the output 
(differential signal) of the motion compensator 117, the 
encoded length of the encoded video signal, and the 
residual quantity information of the buffer 125. 
[0099] That is. the encoding rate controller 120 
receives the encoding rate information on a low resolu- 
tion video signal sent from the encoding rate controller 
108. And when the encoding rate information from the 
encoding rate controller 108 indicates that an encoding 
rate is high, the encoding rate for a high resolution video 
signal is reduced so that it does not exceed the total 
encoding rate. In this case, as described above, picture 
quality will not be influenced so much even if the encod- 
ing rate for a high resolution video signal is reduced. 
[01 00] Thus, in this embodiment, i.e., when the quan- 
tity of the high frequency component contained in the 
input signal 100 is small, the encoding rate for a tow res- 
olution video signal is increased and the encoding rate 
for a high resolution video signal is reduced. 
[0101] With this, the compression distortion of a low 
resolution video signal can be reduced, so a low resolu- 
tion video signal with higher picture quality is obtained. 
Furthermore, with this, the picture quality of a high res- 
olution video signal employing a low resolution video 
signal with enhanced picture quality can also be 
improved at the same time. 

(Second Embodiment) 

[01 02] For the video signal layering-encoding appara- 
tus(system) according to a second embodiment of the 
present invention, a description will be made of the con- 
stitution and operation in reference to FIG. 2. FIG. 2 
illustrates a block diagram of the video signal layering- 
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encoding system of this embodiment. 
[0103] In FIG. 2, the same reference numerals will be 
applied to the same parts as FIG. 1 and therefore a 
description thereof is omitted. 

[0104] That is, in FIG. 2, 201 is a differential signal s 
generator, 202 a motion detector, and 203 image mem- 
ory. 

[0105] As the operation from a resolution converter 
101 to a buffer 113 is the same as the contents men- 
tioned in FIG. 1 . a description thereof is not given. 10 
[01 06] A resolution converter 114 converts the resolu- 
tion of the output (reproduced video signal) of a motion 
compensator 111 to the same resolution as an input 
video signal 100 and outputs the converted signal. 
[01 07] The differential signal generator 201 generates is 
a differential signal from the input video signal 100 and 
the output of the resolution converter 114. 
[0108] The motion detector 202 stores the encoded 
frame of the input video signal 1 00 in the image memory 
203 and also detects the motion of a macroblock unit so 
from the encoded frame and the previously encoded 
and decoded past reference frame in the image mem- 
ory 203. 

[01 09] A motion compensator 1 1 7 outputs a differen- 
tial signal between the output of the differential signal 25 
generator 201 and the reproduced signal at the same 
position as the reference frame detected by the motion 
detector 202 in the unit of a macroblock. 
[01 1 0] This embodiment exhibits the following advan- 
tages in addition to the advantages mentioned in the 30 
above-mentioned first embodiment. 
[0111] That is, by having the frequency distribution 
measuring unit 102 and the differential signal generator 
201 , encoding quantity control according to a frequency 
component contained in the input video signal 100 can 35 
be performed between layers in the hierarchical coding 
in which an encoded signal at a high resolution compo- 
nent is a differential signal with a video signal repro- 
duced from a low resolution component 
[0112] Note that the motion detector 202 in this 40 
embodiment may use the output (video signal) of the 
resolution converter 114 when motion is detected. 

(Third Embodiment) 

45 

[01 1 3] In FIG. 3, the same reference numerals will be 
applied to the same parts as FIG. 1 and therefore a 
description thereof is omitted. 

[01 1 4] That is, in FIG. 3, 30 1 is a motion judgment unit 
and 302 an encoding rate controller. so 
[0115] As shown in the figure, the motion judgment 
unit 301 judges the motion of an input video signal 100 
from the motion detection result of a motion detector 
1 03 and outputs the result of the judgment. 
[0116] The encoding rate controller 302 determines 55 
the quantization step of the encoded frame of the input 
video signal 100 for each macroblock, based on the out- 
put of the motion judgment unit 301 , the output (differ- 
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ential signal) of a motion compensator 105. the 
encoded length of the encoded video signal, and the 
residual quantity of a buffer 1 1 3. 
[01 17] In this embodiment, by having the motion judg- 
ment unit 301, encoding quantity control according to 
the motion of the input video signal 100 can be per- 
formed between layers. 

[01 18] Note that the motion judgment unit 301 in this 
embodiment may judge motion not by employing the 
result of the motion detected at the motion detector 103 
but by employing the result of the motion detected at the 
motion detector 1 15 which detects motion only from the 
encoded frame of the original video signal and a refer- 
ence frame. 

(Fourth Embodiment) 

[01 19] In FIG. 4, the same reference numerals will be 
applied to the same parts as FIGS. 1 and 2 and there- 
fore a description thereof is omitted. In the figure, 401 is 
a motion judgment unit and 402 an encoding rate con- 
troller. 

[0120] The motion judgment unit 401 judges the 
motion of an input video signal 100 from the motion 
detection result of a motion detector 202 and outputs 
the result of the judgment. 

[0121] Thus, the motion judgment unit 401 can 
enhance motion judgment accuracy, unlike the above- 
mentioned embodiment where motion is judged based 
on the converted low resolution video signal. 
[0122] The encoding rate controller 402 determines 
the quantization step of the encoded frame of the input 
video signal 100 for each macroblock, based on the out- 
put of the motion judgment unit 401, the output (differ- 
ential signal) of a motion compensator 105, the 
encoded length of the encoded video signal, and the 
residual quantity of a buffer 113. 
[0123] In this embodiment, by having the differential 
signal generator 201 and the motion judgment unit 401 , 
encoding quantity control according to the motion of the 
input video signal 100 can be performed between layers 
in the hierarchical coding in which an encoded signal at 
a high resolution component is a differential signal with 
a video signal reproduced from a low resolution compo- 
nent. 

[0124] Note that the motion judgment unit 401 in this 
embodiment may judge motion by employing the result 
of motion detected at the motion detector 103. 

(Frfth Embodiment) 

[01 25] In FIG. 5, the same reference numerals will be 
applied to the same parts as FIGS. 1 and 3 and there- 
fore a description thereof is omitted. In the figure. 501 is 
an encoding rate controller. 

[01 26] As shown in FIG. 5, the encoding rate control- 
ler 501 determines the quantization step of the encoded 
frame of an input video signal 100 for each macroblock, 
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based on the output of a frequency distribution measur- 
ing unit 102, the output of a motion judgment unit 301, 
the output (differential signal) of a motion compensator 
105, the encoded length of an encoded video signal, 
and the residual quantity of a buffer 113. 5 
[0127] In this embodiment, by having the frequency 
distribution measuring unit 102, encoding quantity con- 
trol according to a frequency component contained in 
the input video signal 100 can be performed between 
layers, and by having the motion judgment unit 301, w 
encoding quantity control according to the motion of the 
input video signal 100 can be performed between lay- 
ers. 

[0128] Note that the motion judgment unit 301 in this 
embodiment may judge motion not by employing the is 
result of the motion detected at the motion detector 103 
but by employing the result of the motion detected at the 
motion detector 1 1 5 which detects motion only from the 
encoded frame of the original video signal and a refer- 
ence frame. 20 

(Sixth Embodiment) 

[0129] In FIG. 6, the same reference numerals will be 
applied to the same parts as FIGS. 1, 2, and 4 and 25 
therefore a description thereof is omitted. In the figure, 
601 is an encoding rate controller. 
[0130] As shown in FIG. 6, the encoding rate control- 
ler 601 determines the quantization step of the encoded 
frame of an input video signal 1 00 for each macroblock, 30 
based on the output of a frequency distribution measur- 
ing unit 102, the output of a motion judgment unit 401, 
the output (differential signal) of a motion compensator 
105. the encoded length of an encoded video signal, 
and the residual quantity of a buffer 113. 35 
[0131] Note that the motion judgment unit 401 in this 
embodiment may judge motion by employing the result 
of motion detected at the motion detector 103. 
[0132] In the aforementioned embodiments, although 
the frequency distribution measuring means of the 40. 
present invention employs a high-pass filter having a 
passband higher than a frequency limited by the resolu- 
tion converter 101, the present invention is not limited to 
this. For example, the frequency distribution measuring 
means may be constructed as follows. 45 
[0133] That is, when the resolution converter 101 is 
limited by a low-pass fitter and also the frequency char- 
acteristic is represented by F, a high-pass fitter repre- 
sented by 1 - F may be employed. In this case, when the 
output signal component of the high-pass filter is less so 
than a predetermined value, the rate at which a signal is 
encoded by the encoding rate controller 103, 501 or 601 
is increased. 

[01 34] As another constitution, the frequency distribu- 
tion measuring unit 102 may convert an input video sig- ss 
nal to a low resolution video signal in the same manner 
as the resolution converter 101 and add the absolute 
value sum of a differential signal between a reproduced 



video signal with the same resolution as the input video 
signal and the input video signal in the same manner as 
the resolution converter 114. In this case, when the 
absolute value sum is small, the rate at which a signal is 
encoded by the encoding rate controller 108, 501 or 601 
is increased. 

[01 35] As still another constitution, the frequency dis- 
tribution measuring unit 102 may convert an input video 
signal to a low resolution video signal in the same man- 
ner as the resolution converter 101 and add the abso- 
lute value sum of a differential signal between a 
reproduced video signal with the same resolution as the 
input video signal and the input video signal in the same 
manner as the resolution converter 1 14 only when the 
absolute value sum is greater than a predetermined 
value. In this case, when the absolute value sum is 
small, the rate at which a signal is encoded by the 
encoding rate controller 108, 501 or 601 is increased. 
[01 36] Also, the motion judgment unit 301 and motion 
judgment unit 401 in the aforementioned embodiment 
may increase the rate at which a signal is encoded by 
the encoding rate controller 108, 501 or 601, when 
motion is great 

[01 37] In the above-mentioned embodiments, while it 
has been described that the sum of the encoded bit 
streams output from the buffers 113 and 125 is always 
constant per unit time, the present invention is not lim- 
ited to this. Even if the sum of the bit streams varies with 
time, the above-mentioned embodiments will be appli- 
cable. 

(Seventh Embodiment) 

[01 38] For the video signal layering-encoding appara- 
tus(system) according to a seventh embodiment of the 
present invention, a description will be made of the con- 
stitution and operation in reference to FIG. 7. FIG. 7 
illustrates a block diagram of the video signal layering- 
encoding system of this embodiment. 
[0139] In the figure, 701 is an input terminal to which 
a video signal is input, 702 a resolution reduction unit for 
reducing the resolution of the input video signal to a pre- 
determined resolution, 703 a first encoder for encoding 
the input video signal at a low bit rate, 704 a second 
decoder for decoding the input video signal at a low bit 
rate, 705 an interpolator for interpolating the number of 
the pixels of the input signal so that it becomes a prede- 
termined number of pixels, and 706 a second encoder 
for encoding the input video signal at a low bit rate. 
[0140] The operation of the aforementioned constitu- 
tion will hereinafter be described. 
[0141] A high resolution signal input through the input 
terminal 701 is output to the second encoder 706 and 
the resolution reduction unit 702. The resolution reduc- 
tion unit 702 reduces the resolution of the input signal to 
a predetermined resolution and outputs the resolution 
reduced signal to the first encoder 703. The first 
encoder 703 encodes the input signal at a low bit rate 
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and outputs the encoded data to the second decoder 
704. The second decoder 704 decodes the input signal 
at a low bit rate and outputs the decoded signal to the 
interpolator 705. The interpolator 705 interpolates the 
input video signal so that the number of the pixels 5 
thereof becomes the same number of pixels as the high 
resolution signal, and then outputs the interpolated sig- 
nal to the second encoder 706. 
[0142] In the second encoder 706, the high resolution 
signal is encoded at a tow bit rate and output by either 10 
spatial resolution predictive coding which employs pre- 
diction in a spatial axis direction (e.g., encoding of a dif- 
ference between an interpolated signal and a high 
resolution signal), intraframe coding which employs 
data within the frame of a high resolution signal, inter- is 
frame forward predictive coding which employs forward 
prediction in the time axis direction of a high resolution 
signal, or irrterframe bidirectional predictive coding 
which employs bidirectional prediction in the time axis 
direction of a high resolution signal. 20 
[0143] Here, when the second encoder 706 performs 
irrterframe bidirectional predictive coding, predicted dif- 
ferential data is not encoded, but only the motion vector 
detected by employing irrterframe bidirectional predic- 
tion is encoded. 25 
[0144] Generally, since a bkJirectionally predicted 
frame is often the average of two frames, it becomes an 
object of encoding, but even if a motion vector alone 
were encoded, a great influence will not occur on pic- 
ture quality. In the case where a high resolution signal is 30 
decoded, it is also possible to employ the interpolated 
image of the decoded image of a low resolution signal. 
Therefore, even if a motion vector alone were encoded, 
picture quality will not be degraded. 
[0145] As described above, the video signal encoding 35 
system of the present invention is capable of increasing 
the encoding efficiency of a high resolution signal, 
because the encoding quantity of a bidirectionally pre- 
dicted and coded high resolution signal can be reduced 
by encoding only a motion vector employing irrterframe 40 
bidirectional prediction. 

(Eighth Embodiment) 

[0146] In FIG. 8. 801 is an input terminal to which a 45 
video signal is input, 802 a resolution reduction unit for 
reducing the resolution of the input video signal to a pre- 
determined resolution, 803 a first encoder for encoding 
the input video signal at a low bit rate, 804 a second 
decoder for decoding the input video signal at a low bit so 
rate, 805 an interpolator for interpolating the number of 
the pixels of the input signal so that it becomes a prede- 
termined number of pixels, and 806 a second encoder 
for encoding the input video signal with a predetermined 
control determined by input information. 55 
[0147] The operation of the aforementioned constitu- 
tion will hereinafter be described. 
[0148] A high resolution signal input through the input 
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terminal 801 is output to the second encoder 806 and 
the resolution reduction unit 802. The resolution reduc- 
tion unit 802 reduces the resolution of the input signal to 
a predetermined resolution and outputs the resolution 
reduced signal to the first encoder 803. 
[01 49] The first encoder 803 encodes a low resolution 
signal at a low bit rate by either (1) intraframe coding 
which employs data within the frame of a low resolution 
signal, (2) irrterframe forward predictive coding which 
employs forward prediction in the time axis direction of a 
low resolution signal, or (3) irrterframe bidirectional pre- 
dictive coding which employs bidirectional prediction in 
the time axis direction of a low resolution signal. The 
first encoder 803 outputs the encoded data to the sec- 
ond decoder 804 and also outputs to the second 
encoder 806 which of the intraframe coding, the irrter- 
frame forward predictive coding, and the irrterframe bidi- 
rectional predictive coding was employed to encode the 
encoded data. The second decoder 804 decodes the 
input signal at a low bit rate and outputs the decoded 
signal to the interpolator 805. The interpolator 805 inter- - 
polates the input video signal so that the number of the 
pixels thereof becomes the same number of pixels as 
the input video signal, and then outputs the interpolated 
signal to the second encoder 806. 
[01 50] In the second encoder 806, the high resolution 
signal is encoded at a low bit rate and output by (1 ) spa- 
tial resolution predictive coding which employs predic- 
tion in a spatial axis direction (e.g., encoding of a 
difference between an interpolated signal and a high 
resolution signal) and <2) coding of the same type as the 
coding type employed when each frame converted to a 
low resolution signal is encoded at the first encoder 803. 
As previously described, the information on which 
encoding type was employed in the first encoder 803 is 
sent from the first encoder 803 to the second encoder 
806. 

[0151] Also, when the second encoder 806 in this 
embodiment, as with the seventh embodiment, per- 
forms irrterframe bidirectional predictive coding, pre- 
dicted differential data is not encoded, but only the 
motion vector detected by employing irrterframe bidirec- 
tional prediction is encoded. 

[0152] Thus, in the video signal encoding system in 
this embodiment, in addition to the same advantage as 
the seventh embodiment, frame encoding types 
become the same when a low resolution signal and a 
high resolution signal are encoded, so it becomes pos- 
sible to use the motion vector of a low resolution signal 
in encoding a high resolution signal, and consequently, 
error tolerance is increased. 

[01 53] As a variation of the above-mentioned embod- 
iment, the present invention may be constituted so that 
when the first encoder 803 performs intraframe coding, 
the above-mentioned second encoder 806 performs the 
intraframe coding on a frame corresponding to the 
frame. With this constitution, the degree of importance 
relative to an error in the above-mentioned frame is 
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increased, and therefore, by strengthening error toler- 
ance in that frame, error tolerance in the entire stream 
can be easily strengthened. 

(Ninth Embodiment) s 

[01 54] A ninth embodiment of the present invention is 
the same as FIG. 8 and differs only in the operation of 
the second encoder 806. 

[0155] The operation of the second encoder 806 in w 
this embodiment will hereinafter be described. 
[01 56] In the second encoder 806 in this embodiment, 
for a frame corresponding to a frame encoded at the first 
encoder 803 by either intraframe coding or interframe 
forward directional predictive coding, a motion vector is 
employing interframe bidirectional prediction is 
encoded, and a frame corresponding to a frame which 
is encoded by interframe bidirectional predictive coding 
is encoded by either intraframe coding or interframe for- 
ward directional predictive coding. so 
[0157] In the coding method employing the time axis 
direction of a video signal, in order to enhance picture 
quality, an encoding quantity is allocated to intraframe 
coding or interframe bidirectional coding and is not allo- 
cated to interframe bidirectional coding which is the 25 
average of two frames. Therefore, generally picture 
quality is better in intraframe coding or interframe for- 
ward directional coding than in interframe bidirectional 
coding. 

[01 58] Hence, by setting the above-mentioned encod- 30 
ing mode, a reference frame, which is encoded by spa- 
tial inter-resolution predictive coding when a high 
resolution signal is encoded by interframe bidirectional 
predictive coding, is encoded by either the intraframe 
coding or interframe forward directional predictive cod- 35 
ing of a low resolution signal. Therefore, since the refer- 
ence frame in this embodiment has higher picture 
quality as compared with the eighth embodiment, spa- 
tial inter-resolution predictive coding can be more effec- 
tively utilized. As a result, encoding of a motion vector 40 
becomes unnecessary and the encoding efficiency can 
be enhanced. 

[0159] Note that the encoding of a motion vector 
becomes unnecessary only when the first encoder 803 
performs interframe forward directional predictive cod- 45 
ing. As described above, in the video signal encoding 
system in this embodiment, in addition to the same 
advantage as the seventh embodiment, the picture 
quality of a reference frame obtained by spatial inter- 
resolution prediction is enhanced when interframe btdi- so 
rectional predictive coding is performed, whereby the 
encoding efficiency of a high resolution signal can be 
improved. 

(Tenth Embodiment) ss 

[0160] A tenth embodiment of the present invention is 
the same as FIG. 8 and differs only in the operation of 



the second encoder 806. 

[0161] The operation of the second encoder 806 in 
this embodiment will hereinafter be described. 
[01 62] In the second encoder 806 in this embodiment, 
for a frame corresponding to a frame encoded at the first 
encoder 803 by either interframe forward directional 
coding or interframe bidirectional predictive coding, 
encoding of the same type is performed, and a frame 
corresponding to a frame encoded at the first encoder 
803 by intraframe coding is encoded at a low bit rate by 
employing only spatial inter-resolution predictive cod- 
ing. 

[0163] Thus, since a high resolution signal is not 
encoded by intraframe coding, an encoding quantity 
can be reduced and therefore the encoding efficiency of 
a high resolution signal can be improved. 

(Eleventh Embodiment) 

[0164] An eleventh embodiment of the present inven- 
tion is the same as FIG. 7 and differs only in the opera- 
tion of the second encoder 706. 
[0165] The operation of the second encoder 706 in 
this embodiment will hereinafter be described. 
[01 66] In the second encoder 706 in this embodiment, 
encoding is performed at intervals of M frames (where 
M £ 1) by employing only spatial inter-resolution predic- 
tive coding. The other frames are encoded by either 
interframe forward directional predictive coding or inter- 
frame bidirectional predictive coding. 
[0167] Thus, as with the tenth embodiment, a high 
resolution signal is not encoded by intraframe coding, 
so that the encoding quantity can be reduced and the 
encoding efficiency of a high resolution signal can be 
increased. Furthermore, as a difference with an interpo- 
lated image is encoded at intervals of M frames, error 
propagation in a time axis direction can be stopped at 
intervals of M frames. Therefore, as M becomes 
smaller, this embodiment has better error tolerance. If M 
is less than the GOP unit in the tenth embodiment, this 
embodiment will have better error tolerance than the 
tenth embodiment. 

(Twelfth Embodiment) 

[01 68] A twelfth embodiment of the present invention 

is the same as FIG. 8 and differs only in the operation of 

the first and second encoders 803 and 806. 

[01 69] The operation of the first and second encoders 

803 and 806 in this embodiment will hereinafter be 

described. 

[0170] The first encoder 803 in this embodiment 
encodes an input signal at a low bit rate and outputs the 
encoded data to a second decoder 804. The first 
encoder 803 also outputs both the motion vector used in 
the encoding and the encoding type to the second 
encoder 806. In the second encoder 806, for the frame 
of the encoding type encoded at the first encoder 803 by 
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either interframe forward directional predictive coding or 
interframe bidirectional predictive coding, the input 
motion vector multiplied by a predetermined number is 
used as a motion vector in order to exclude the data of 
the motion vector, and then encoding is performed. 5 
[0171] Therefore, in the video signal encoding system 
in this embodiment the overall circuit size can be 
reduced because the motion vector of the frame of a 
high resolution signal is not detected, and the encoding 
efficiency of a high resolution signal can be increased 10 
because a motion vector is not encoded. 

(Thirteenth Embodiment) 

[01 72] For the video signal layering-encoding appara- is 
tus(system) according to a thirteenth embodiment of the 
present invention, a description will be made of the con- 
stitution and operation in reference to FIG. 9. FIG. 9 
illustrates a block diagram of the video signal layering- 
encoding apparatus(system) of this embodiment. 20 
[0173] In the figure, 901 is an input terminal to which 
a video signal is input, 902 a resolution reduction unit for 
reducing the resolution of the input video signal to a pre- 
determined resolution, 903 a first encoder for encoding 
the input video signal at a low bit rate by employing input 25 
information, 904 a second decoder for decoding the 
input video signal at a low bit rate, 905 an interpolator 
for interpolating the number of the pixels of the input sig- 
nal so that it becomes a predetermined number of pix- 
els, 906 a second encoder for encoding the input video 30 
signal by employing input information, and 907 a motion 
vector detector for detecting the motion vector between 
input signals. 

[0174] The operation of the aforementioned constitu- 
tion will hereinafter be described. 35 
[01 75] A high resolution signal input through the input 
terminal 901 is output to the motion vector detector 907, 
the second encoder 906, and the resolution reduction 
unit 902. The motion vector detector 907 detects the 
motion vector of the input signal and outputs the 40 
detected motion vector to the second encoder 906 and 
the first encoder 903. The resolution reduction unit 902 
reduces the resolution of the input signal to a predeter- 
mined resolution and outputs the resolution reduced 
signal to the first encoder 903. The first encoder 903 45 
uses the input motion vector multiplied by a predeter- 
mined number as a motion vector so that a low resolu- 
tion signal is encoded at a low bit rate. The first encoder 
903 outputs the encoded data to the second decoder 
904. The second decoder 904 decodes the input signal so 
at a tow bit rate and outputs the decoded signal to the 
interpolator 905. The interpolator 905 interpolates the 
input video signal so that the number of the pixels 
thereof becomes the same number of pixels as the input 
video signal, and then outputs the interpolated signal to ss 
the second encoder 906. 

[01 76] The second encoder 906 encodes and outputs 
a high resolution signal at a low bit rate by using both 



289 A2 36 

spatial resolution predictive coding which employs pre- 
diction in a spatial axis direction (e.g., encoding of a dif- 
ference between an interpolated signal and a high 
resolution signal) and the input motion vector. In this 
case, the motion vector is also encoded. 
[0177] Note that, due to the same reason as the 
above-mentioned embodiment, the first encoder 903 
encodes and outputs a low resolution signal at a low bit 
rate, excluding a motion vector. 
[01 78] Therefore, in the video signal encoding system 
in this embodiment, the overall circuit size can be 
reduced because the motion vector of the frame of a low 
resolution signal is not detected, and the encoding effi- 
ciency of a high resolution signal can be increased 
because a motion vector is not encoded. 
[01 79] Also, this embodiment enhances motion vector 
accuracy, because it is constituted so that a motion vec- 
tor between input signals with high resolution is 
detected. 

(Fourteenth Embodiment) 

[01 80] In FIG. 10, 1 001 is an input terminal to which a 
video signal is input 1002 a resolution reduction unit for 
reducing the resolution of the input video signal to a pre- 
determined resolution, 1003 a first encoder for encoding 
the input video signal at a low bit rate, 1004 a second 
decoder for decoding the input video signal at a low bit 
rate, 1005 an interpolator for interpolating the number of 
the pixels of the input signal so that it becomes a prede- 
termined number of pixels, 1006 a differential unit for 
computing a difference between input signals, 1007 a 
band, divider for dividing the band of the input signal, 
and 1008 a second encoder for encoding the input 
video signal. 

[01 81 ] The operation of the aforementioned constitu- 
tion will hereinafter be described. 
[01 82] A high resolution signal input through the input 
terminal 1001 is output to the resolution reduction unit 
1002 and differential unit 1006. The resolution reduction 
unit 1 002 reduces the resolution of the input signal to a 
predetermined resolution and outputs the resolution 
reduced signed to the first encoder 1003. The first 
encoder 1003 encodes the input signal at a low bit rate 
and outputs the encoded data to the second decoder 
1004. The second decoder 1004 decodes the input sig- 
nal at a low bit rate and outputs the decoded signal to 
the interpolator 1005. The interpolator 1005 interpo- 
lates the input video signal so that the number of the 
pixels thereof becomes the same number of pixels as 
the input video signal, and then outputs the interpolated 
signal to the differential unit 1006. The differential unit 
1006 computes differential data between the same 
frames of the input signals and outputs the differential 
data to the band divider 1007. The band divider 1007 
divides the input signal into a plurality of video signals 
having a predetermined band and outputs them to the 
second encoder 1008. The second encoder 1008 
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encodes and outputs the input signals at a low bit rate. 
[01 83] As described above, the video signal encoding 
system in this embodiment employs different kinds of 
encoding methods in a low resolution signal and a high 
resolution signal. Therefore, if both signals are com- s 
bined together, a high resolution signal can be encoded 
so that it is effective. As a result, it becomes possible to 
enhance the picture quality of a high resolution signal. 

(Fifteenth Embodiment) io 

[0184] In FIG. 11, 1101 is a demodulating section, 
1 102 a separating section, 1 103 an audio signal decod- 
ing section, 1 104 a video signal decoding section, 1 105 
a variable-length decoder, 1106 an inverse quantizer, is 
1107 an IDCT unit, 1108 a motion compensator, 1109 
memory, 1110a memory controller, 1111a video signal 
decoding section, 1112a variable-length decoder, 1113 
an inverse quantizer, 1 1 14 an inverse differential pulse 
code modulation (DPCM) unit, 1115a motion compen- so 
sator, 1116 memory, 1117 a memory controller, and 
1 1 18 an overlay section. 

[0185] The operation in the aforementioned constitu- 
tion will hereinafter be described. 

[0186] The demodulating section 1101 performs a 25 
predetermined demodulation on a received digital 
broadcast, thereby generating an MPEG stream. 
[0187] The separating section 1102 separates the 
video and audio signal compressed streams on a pre- 
determined channel from the generated MPEG stream. 30 
[0188] The audio signal decoding section 1103 
decodes the audio signal compressed stream and out- 
puts an audio signal. 

[0189] In the video signal decoding section 1 104, (1) 
the variable-length decoder 1105 variable-length 35 
decodes the aforementioned video signal compressed 
stream and outputs the motion vector of a macroblock 
unit, a quantization step, and DOT coefficients, (2) the 
inverse quantizer 1106 inversely quantizes the DCT 
coefficients by the quantization step decoded in the unit 40 
of a macroblock, (3) the IDCT unit 1107 outputs the 
inversely quantized DCT coefficients as IDCT coeffi- 
cients, (4) the motion compensator 1108 reproduces a 
video signal from the IDCT coefficients obtained by 
employing a motion vector and also from the signal as 
stored in the memory 1 109 in a macroblock unit, and (5) 
the memory controller 1110 controls the storage of the 
reproduced video signal to the memory 1 1 09, the output 
of the video signal stored in the memory 1 109 to the 
motion compensator 1 108, and the output of the repro- so 
duced video signal, thereby outputting a decoded video 
signal A. 

[01 90] On the other hand, in the video signal decoding 
section 1 1 1 1 . (1) the variable-length decoder 1 1 12 vari- 
able-length decodes the video signal compressed ss 
stream and outputs the motion vector of a macroblock 
unit, a quantization step, and DC coefficients, (2) the 
inverse quantizer 1113 inversely quantizes by the 



decoded quantization step only the DC coefficients 
quantized at the time of encoding, (3) the inverse DPCM 
unit 1114 performs inverse DPCM on only the DC coef- 
ficients on which DPCM was performed at the time of 
encoding, (4) the motion compensator 1115 reproduces 
a video signal from a signal reproduced by employing a 
motion vector multiplied by 1/8 and also from a signal 
stored in the memory 1 1 16 in a macroblock unit, and (5) 
the memory controller 1117 controls the storage of the 
reproduced video signal to the memory 1116, the output 
of the video signal stored in the memory 1 1 16 to the 
motion compensator 1115, and the output of the repro- 
duced video signal, thereby outputting a decoded video 
signal B. 

[01 91 ] In the overlay section 1118, the video signal B 
(which is 1/8 of the video signal A in both horizontal and 
vertical directions) reproduced at the video signal 
decoding section 1111 is overlaid at a predetermined 
position on the video signal A reproduced at the video 
signal decoding section 1 104, and the overlaid signal is 
output. 

[01 92] The video signal decoding section 1 1 1 1 in this 
embodiment is realizable by a signal process very easy 
as compared with the video signal decoding section 
1104 and with a less memory quantity (specifically, 
memory capacity of 1/64 of the memory 1 109), so it is 
also realizable by software. Also, a predetermined vec- 
tor transformation may be employed to obtain the 
motion vector multiplied by 1/8. 

[0193] With this, the digital broadcast decoding sys- 
tem in this embodiment can readily display a broadcast- 
ing program on a different channel onto a small screen 
within a main screen during reception of digital broad- 
casts, by having the structurally simple video signal 
decoding section 1111 in a conventional digital broad- 
cast decoding system. 

[0194] Next, the operation of the above-mentioned 
video signal decoding section 1111 will be described 
further in reference to FIG. 1 5. 

[01 95] FIG. 1 5 shows a flowchart used to explain algo- 
rithm. 

[0196] In the figure, in step 1 , variable-length decod- 
ing is performed on the video signal stream compressed 
by the MPEG standard, whereby only the motion vector, 
quantization step, and DC coefficients are extracted. 
[0197] In step 2, only when the DC coefficients have 
been quantized, they are inversely quantized by the 
quantization step decoded. 

[0198] In step 3, only when DPCM has been per- 
formed on the DC coefficients, inverse DPCM is per- 
formed on the decoded DC coefficients. 
[0199] In step 4 the decoded motion vector is multi- 
plied by 1/8 in both the horizontal and vertical directions, 
and motion compensation is performed by employing 
video signals corresponding to the DC component 
being reproduced and the previously reproduced DC 
component. 

[0200] In step 5 the video signals corresponding to the 



20 

. <EP 0901269A2_I_> 



39 



EP0 901 289 A2 



40 



motion compensated DC components are stored tem- 
porarily, and the video signals are output in display 
order. 

[0201] By employing the aforementioned algorithm, 
the video signal stream compressed by the MPEG 
standard can be readily reproduced in a size of 1/8 in 
both the horizontal and vertical directions. 
[0202] Note that since the aforementioned algorithm 
is an easy process, it is realizable by software and can 
also be processed in parallel. 

[0203] Also, a predetermined vector transformation 
may be employed to obtain the motion vector multiplied 
by 1/8. 

(Sixteenth Embodiment) 

[0204] In FIG. 12 the same reference numerals will be 
applied to the same parts as FIG. 1 1 and therefore a 
description thereof is omitted. 

[0205] In FIG. 12, 1201 is a video signal decoding sec- 
tion, 1202 a variable-length decoder, 1203 an inverse 
quantizer, 1204 an inverse differential pulse code mod- 
ulation (DPCM) unit, 1205 a motion compensator, 1206 
memory, and 1207 a memory controller. 
[0206] The operation in the aforementioned constitu- 
tion will hereinafter be described. 
[0207] The demodulating section 1101 performs a 
predetermined demodulation on a received digital 
broadcast, thereby generating an MPEG stream. 
[0208] The separating section 1102 separates the 
video and audio signal compressed streams on a pre- 
determined channel from the generated MPEG stream. 
[0209] The audio signal decoding section 1103 
decodes the audio signal compressed stream and out- 
puts an audio signal. 

[0210] The video signal decoding section 1 104 out- 
puts a decoded video signal A. 
[0211] In the video signal decoding section 1201, (1) 
the variable-length decoder 1202 variable-length 
decodes the video signal compressed stream and out- 
puts the motion vector of a macroblock unit, a quantiza- 
tion step, and M x N OCT coefficients (M coefficients in 
a horizontal direction where M is a natural number from 
1 to 8 and N coefficients in a vertical direction where N 
is a natural number from 1 to 8), (2) the inverse quan- 
tizer 1 203 inversely quantizes by the decoded quantiza- 
tion step only the M x N DCT coefficients quantized at 
the time of encoding, (3) the inverse DPCM unit 1204 
performs inverse DPCM on the M x N DCT coefficients 
on which DPCM was performed at the time of encoding 
and then outputs anMxN signal. (4) the motion com- 
pensator 1205 reproduces a video signal from a signal 
reproduced by employing a motion vector multiplied by 
M/8 in the horizontal direction and by N/8 in the vertical 
direction and also from a signal stored in the memory 
1206 in a macroblock unit, and (5) the memory control- 
ler 1207 controls the storage of the reproduced video 
signal to the memory 1206, the output of the video sig- 



nal stored in the memory 1 206 to the motion compensa- 
tor 1205, and the output of the reproduced video signal, 
thereby outputting a decoded video signal B. 
[021 2] In the overlay section 1 1 1 8, the video signal B 

5 (which is M/8 of the video signal A in the horizontal 
direction and N/8 of the video signal A in the vertical 
direction) reproduced at the video signal decoder 1201 
is overlaid at a predetermined position on the video sig- 
nal A reproduced at the video signal decoding section 

io 1201 , and the overlaid signal is output 

[0213] The video signal decoding section 1201 in this 
embodiment is realizable by a signal process very easy 
as compared with the video signal decoding section 
1 104 and with a less memory quantity, so it ts also real- 

75 izable by software. Also, a predetermined vector trans- 
formation may be employed to obtain the motion vector 
multiplied by M/8 in the horizontal direction and by N/8 
in the vertical direction. 

[0214] With this, the digital broadcast decoding sys- 
20 tern in this embodiment can readily display a broadcast- 
ing program on a different channel onto a small screen 
within a main screen during and reception of digital 
broadcasts, by having the structurally simple video sig- 
nal decoding section 1201 in a conventional digital 
25 broadcast decoding system. 

[0215] Next, the operation of the above-mentioned 
video signal decoding section 1201 will be described 
further in reference to FIG. 16. 
[0216] FIG. 16 shows a flowchart used to explain algo- 
30 rithm. 

[0217] In the figure, in step 1 , variable-length decod- 
ing is performed on the video signal stream compressed 
by the MPEG standard, whereby only the motion vector, 
quantization step, and MxN DCT coefficients (M coef- 

35 ficients in a horizontal direction where M is a natural 
number from 1 to 8) are extracted. 
[0218] In step 2 the DCT coefficients are inversely 
quantized by the quantization step decoded. 
[0219] In step 3, inverse DCT is performed on the M x 

40 N DCT coefficients. 

[0220] In step 4 the decoded motion vector is multi- 
plied by N/8 in the horizontal direction and by M/8 in the 
vertical direction, and motion compensation is per- 
formed by employing the signal being reproduced and 

45 the previously reproduced signal. 

[0221] In step 5 the motion-compensated video sig- 
nals are stored temporarily and output in display order. 
[0222] By employing the aforementioned algorithm, 
the video signal stream compressed by the MPEG 

so standard can be readily reproduced in a size of M/8 in 
the horizontal direction and N/8 in the vertical direction. 
[0223] Note that since the aforementioned algorithm 
is an easy process, it is realizable by software and can 
also be processed in parallel. 

55 [0224] Also, a predetermined vector transformation 
may be employed to obtain the motion vector multiplied 
by M/8 in the horizontal direction and N/8 in the vertical 
direction. 
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(Seventeenth Embodiment) 

[0225] In FIG. 1 3 the same reference numerals will be 
applied to the same parts as FIG. 11 and therefore a 
description thereof is omitted. s 
[0226] The essential difference with the embodiment 
shown in FIG. 1 1 is that K video signal decoding sec- 
tions 1111 are provided as shown in FIG. 13. 
[0227] Next, the operation of this embodiment will be 
described. io 
[0228] A demodulating section 1 101 performs a pre- 
determined demodulation on a received digital broad- 
cast, thereby generating an MPEG stream. 
[0229] A separating section 1 1 02 separates the video 
and audio signal compressed streams on a predeter- 15 
mined channel from the generated MPEG stream. 
[0230] An audio signal decoding section 1103 
decodes the audio signal compressed stream and out- 
puts an audio signal. 

[0231 ] A video signal decoding section 1 1 04 decodes 20 
the video signal compressed stream and outputs a 
decoded video signal A. 

[0232] The K video signal decoding sections 1111 
(where K is a natural number equal to or greater than 1) 
decode the video signal compressed stream and output 25 
a decoded video signal B. 

[0233] In an overlay section 1 1 1 8, the K video signals 
B (which is 1/8 of the video signal A in both horizontal 
and vertical directions) reproduced at the video signal 
decoding section 1111 are overlaid at a predetermined 30 
position on the video signal A reproduced at the video 
signal decoding section 1 104, and the overlaid signals 
are output. 

[0234] The video signal decoding section 1 1 1 1 in this 
embodiment is realizable by a signal process very easy 35 
as compared with the video signal decoding section 
1 104 and with a less memory quantity, so it is also real- 
izable by software. 

[0235] With this, the digital broadcast decoding sys- 
tenvtn this si 1 txjuMi 1 mi 11 can Teadrty display K kinds of 40 
broadcasting p rog rams on different channels onto a 
small screen within a main screen during reception of 
digital broadcasts, by having the K video signal decod- 
ing sections 1111 in a conventional digital broadcast 
decoding system. 45 

(Eighteenth Embodiment) 

[0236] In FIG. 14 the same reference numerals will be 
applied to the same parts as FIG. 12 and therefore a so 
description thereof is omitted. 

[0237] The essential difference with the embodiment 
shown in FIG. 12 is that K video signal decoding sec- 
tions 1201 are provided as shown in FIG. 14. 
[0238] Next, the operation of this embodiment will be ss 
described. 

[0239] A demodulating section 1 101 performs a pre- 
determined demodulation on a received digital broad- 



cast, thereby generating an MPEG stream. 
[0240] A separating section 1 1 02 separates the video 
and audio signal compressed streams on a predeter- 
mined channel from the generated MPEG stream. 
[0241] An audio signal decoding section 1103 
decodes the audio signal compressed stream and out- 
puts an audio signal. 

[0242] A video signal decoding section 1 104 decodes 
the video signal compressed stream and outputs a 
decoded video signal A. 

[0243] The K video signal decoding sections 1201 
(where K is a natural number equal to or greater than 1 ) 
decode the video signal compressed stream and output 
a decoded video signal B. 

[0244] In an overlay section 1 1 1 8, the K video signals 
B (which is M/8 of the video signal A in the horizontal 
direction and N/8 of the video signal A in the vertical 
direction) reproduced at the video signal decoding sec- 
tion 1111 are overlaid at a predetermined position on 
the video signal A reproduced at the video signal decod- 
ing section 1 104, and the overlaid signals are output. 
[0245] The video signal decoding section 1201 in this 
embodiment is realizable by a signal process very easy 
as compared with the video signal decoding section 
1 104 and with a less memory quantity, so it is also real- 
izable by software. 

[0246] With this, the digital broadcast decoding sys- 
tem in this embodiment can readily display K kinds of 
broadcasting programs on 'different channels onto a 
small screen within a main screen during reception of 
digital broadcasts, by having the K video signal decod- 
ing sections 1201 in a conventional digital broadcast 
decoding system. 

(Nineteenth Embodiment) 

[0247] For a digital broadcasting signal storage 
according to a nineteenth embodiment of the present 
invention, a description will be made of the constitution 
and operation in reference to FIG. 1 7. FIG. 1 7 illustrates 
a block diagram of the digital broadcasting signal stor- 
age of this embodiment. 

[0248] In the figure, 1701 is a demodulating section, 
1702 a separating section, 1703 memory, 1704 a varia- 
ble-length decoding section, 1705 a variable-length 
encoding section, 1706 a multiplexing section, 1707 a 
storage section, and 1 708 a storage medium. 
[0249] In FIG. 1 8, 1 801 is a stream buffer, 1 802 a flag 
detector, 1803 a motion vector detector, 1804 a DCT 
coefficient detector, 1805 a flag converter, 1806 a 
motion vector converter, 1807 a DCT coefficient thin- 
ning unit, and 1808 an encoder. 

[0250] The demodulating section 1701 performs a 
predetermined demodulation on a received digital 
broadcast, thereby generating an MPEG stream. 
[0251] The separating section 1702 separates the 
video and audio signal streams on a predetermined 
channel from the generated MPEG stream. 



22 



<EP 0901269A2_L> 



43 



EP0 901 289 A2 



44 



{0252] The memory 1 703 stores the audio signal com- 
pressed stream temporarily. 

[0253] The variable-length decoding section 1 704 per- 
forms variable-length decoding on the video signal com- 
pressed stream and selects and outputs only various s 
flags, motion vectors, and a predetermined number of 
DCT coefficients (M coefficients in a horizontal direction 
where M is a natural number from 1 to 8 and N coeffi- 
cients in a vertical direction where N is a natural number 
from 1 to 8). 10 
{0254] The variable-length encoding section 1 705 per- 
forms a predetermined flag transformation (e.g., a 
change in the number of horizontal pixels and vertical 
pixels) on the selected various flags and also performs 
a motion vector transformation on the selected motion is 
vectors. Then, the encoding section 1705 performs var- 
iable-length encoding on the results of the transforma- 
tions and performs variable-length encoding on the 
selected predetermined number of DCT coefficients. 
[0255] Here, the variable-length decoding section 20 
1 704 and the variable-length encoding section 1 705 will 
be described in reference to FIG. 18. 
[0256] The variable-length decoding section 1704 
stores an input stream in the stream buffer 1801 tempo- 
rarily. 25 
{0257] The flag detector 1802 detects a flag in the 
stream, then decodes the detected flag, and outputs the 
decoded flag. 

{0258] The motion vector detector 1803 detects a 
motion vector in the stream, then decodes the detected 30 
motion vector, and outputs the decoded motion vector. 
[0259] The DCT coefficient detector 1804 detects 
DCT coefficients in the stream, then decodes the 
detected DCT coefficients, and outputs the decoded 
DCT coefficients. 35 
[0260] In the variable-length encoding section 1 705, 
the flag converter 1805 performs a predetermined flag 
transformation on various flags and outputs the trans- 
formed flags. 

[0261] The motion vector converter 1806 performs a 40 
motion vector transformation (e.g., M/8 times in a hori- 
zontal direction where M is a natural number from 1 to 8 
and N/8 times in a vertical direction where N is a natural 
number from 1 to 8) and outputs the transformed motion 
vector. 45 
[0262] The DCT coefficient thinning unit 1 807 outputs 
a predetermined number of DCT coefficients (e.g.. hori- 
zontal M pixels and vertical N pixels in a low band com- 
ponent where M and N are a natural number from 1 to 
8). so 
[0263] The encoder 1 808 variable-length encodes the 
transformed flag, transformed motion vector, and a pre- 
determined number of DCT coefficients by a predeter- 
mined encoding code and then outputs them. 
[0264] Also, the multiplexing section 1 706 multiplexes ss 
the audio signed compressed stream in the memory 
1 703 and the video signal compressed stream which is 
the output of the variable-length encoding section 1 705. 



[0265] The storage section 1707 stores the multi- 
plexed data in the storage medium 1708. 
[0266] Note that the flag converter 1805. motion vec- 
tor converter 1806. and DCT coefficient thinning unit 
1807 in FIG. 18 are not included in the variable-length 
encoding section 1 705 but may be included in the varia- 
ble-length decoding section 1704. 

(Twentieth Embodiment) 

[0267] In FIG. 1 9 the same reference numerals will be 
applied to the same parts as FIG. 18 and therefore a 
description thereof is omitted. 

[0268] In FIG. 1 9, 1 809 is a field detector, 1810a flag 
converter, 1811 a motion vector converter, and 1812 a 
DCT coefficient thinning unit. 

[0269] A variable-length decoding section 1 704 in this 
embodiment stores an input stream in a stream buffer 
1801 temporarily. 

[0270] A flag detector 1802 detects a flag in the 
stream, then decodes the detected flag, and outputs the 
decoded flag. 

[0271 ] The field detector 1 809 detects whether or not 
the macroblock has a field vector and whether or not a 
field DCT has been performed on the macroblock, and 
outputs the result of detection. 

[0272] A motion vector detector 1 803 detects a motion 
vector in the stream, then decodes the detected motion 
vector, and outputs the decoded motion vector. 
[0273] A DCT coefficient detector 1 804 detects DCT 
coefficients in the stream, then decodes the detected 
DCT coefficients, and outputs the decoded DCT coeffi- 
cients. 

[0274] In a variable-length encoding section 1705 in 
this embodiment, the flag converter 1810 performs a 
predetermined flag transformation on various flags in 
view of the detection result obtained by the field detec- 
tor 1809 and then outputs the transformed flags. 
[0275] The motion vector converter 181 1 performs a 
motion vector transformation (e.g., M/8 times in a hori- 
zontal direction where M is a natural number from 1 to 8 
and N/8 times in a vertical direction where N is a natural 
number from 1 to 8) when a motion vector has been 
determined in a frame unit. Also, when a motion vector 
has been determined in a field unit, the motion vector 
converter 1811 converts the motion vector to a frame 
unit by a predetermined approximation method, then 
performs a motion vector transformation (e.g., M/8 
times in a horizontal direction where M is a natural 
number from 1 to 8 and K/8 times in a vertical direction 
where K is a natural number from 1 to 8), and outputs 
the transformed motion vector. 

[0276] The DCT coefficient thinning unit 1812 selects 
only a predetermined number of DCTcoefficients (e,g., 
M coefficients in a horizontal direction and N coeffi- 
cients in a vertical direction where M and N are a natural 
number from 1 to 8) when DCT coefficients have been 
determined in a frame unit. Also, when DCT coefficients 
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have been determined in a field unit, the DCT coefficient 
thinning unit 1807 deletes one group of DCT coeffi- 
cients and outputs a predetermined number of DCT 
coefficients (M coefficients in a horizontal direction and 
K coefficients in a vertical direction where M and K are 
a natural number from 1 to 8). 

[0277] The encoder 1 808 variable-length encodes the 
transformed flag, transformed motion vector, and a pre- 
determined number of DCT coefficients by a predeter- 
mined encoding code and then outputs them. 
[0278] Note that the flag converter 1810, motion vec- 
tor converter 1811, and DCT coefficient thinning unit 
1812 in FIG. 19 are not included in the variable-length 
encoding section 1 705 but may be included in the varia- 
ble-length decoding section 1704. 

(Twenty-First Embodiment) 

[0279] In FIG. 20 the same reference numerals wilt be 
applied to the same parts as FIG. 17 and therefore a 
description Iheredf Is omitted. 

[0280] In FIG. 20. 1901 is a reproducing section, 1902 
a separating section, 1903 an audio signal decoding 
section, 1904 a video signal decoding section, 1905 a 
variable-length decoder, 1906 an inverse quantizer, 
1907 an IDCT unit. 1908 a motion compensator, 1909 
memory, and 1910 a memory controller. 
[0281] The operation in the aforementioned constitu- 
tion will hereinafter be described. 
[0282] The reproducing section 1901 reproduces 
recorded multiplexed data from a storage medium 1 707. 
[0283] The separating section 1902 separates the 
reproduced multiplexed data into video and audio signal 
compressed streams and then outputs the streams. 
[0284] The audio signal decoding section 1903 
decodes the audio signal compressed stream and out- 
puts an audio signal. 

[0285] In the video signal decoding section 1904, (1) 
the variable-length decoder 1905 variable-length 
decodes -frre -afope mentiui ieU video signal compressed 
stream, and the inverse tjuantizer 1906 inversely quan- 
tizes the decoded video signal stream, (2) the IDCT unit 
1907 performs an inverse MxNorMxK DCT (where 
M, N, and K are a natural number from 1 to 8), (3) the 
motion compensator 1908 reproduces a video signal 
from a signal reproduced by employing a motion vector 
and also from a signal stored in the memory 1909, and 
(4) the memory controller 1910 controls the storage of 
the reproduced video signal to the memory 1909, the 
output of the video signal stored in the memory 1909 to 
the motion compensator 1908, and the output of the 
reproduced video signal. 

[0286] In accordance with this embodiment, if DCT 
coefficients are thinned out. an amount of data to be 
stored can be reduced and the speed of requisite data 
can be slowed down. 



(Twenty-Second Embodiment) 

[0287] In FIG. 21 the same reference numerals will be 
applied to the same parts as FIG. 17 and therefore a 
s description thereof is omitted. 

[0288] In FIG. 21 , 2001 is a video signal decoding sec- 
tion, 2002 a variable-length decoder. 2003 an inverse 
quantizer, 2004 an IDCT unit, 2005 a motion compensa- 
tor, 2006 memory, 2007 a memory controller, 2008 a 
10 video signal encoding section, 2009 a filtering unit, 
2010 memory, 2011 a memory controller, 2012 a differ- 
ential signal generator, 2013 a DCT unit, 2014 a quan- 
tizer, and 2015 a variable-length encoder. 
[0289] The operation in the aforementioned constitu- 
75 tion will hereinafter be described. 

[0290] In the video signal decoding section 2001 , (1) 
the variable-length decoder 2002 variable-length 
decodes a video signal compressed stream, and the 
inverse quantizer 2003 inversely quantizes the decoded 
20 video signal stream, (2) the IDCT unit 2004 performs an 
inverse DCT, (3) the motion compensator 2005 repro- 
duces a video signal from a signal reproduced by 
employing a motion vector and also from a signal stored 
in the memory 2006, and (4) the memory controller 
2007 controls the storage of the reproduced video sig- 
nal to the memory 2006. the output of the video signal 
stored in the memory 2006 to the motion compensator 
2005. and the output of the reproduced video signal. 
[0291 ] On the other hand, in the video signal encoding 
section 2008, the filtering unit 2009 performs a prede- 
termined filtering operation on a video signal which is 
the output of the video signal decoding section 2001, 
thereby changing the resolution of the video signal. 
[0292] The memory controller 201 1 controls the stor- 
age of the filtered video signal to the memory 2010, the 
output of the video signal stored in the memory 2010 to 
the differential signal generator 2012, and the output of 
the filtered video signal. 

[0293] The differential signal generator 201 2 changes 
the motion vector decoded at the video signal decoding 
section 2001 so that the motion vector is suitable to the 
reproduced video signal after the aforementioned filter- 
ing operation, thereby generating a differential signal. 
[0294] The DCT unit 20 1 3 performs DCT on the differ- 
ential signal. The quantizer 2014 changes the quantiza- 
tion step decoded at the video signal decoding section 
2001 so that the quantization step is suitable to the 
reproduced video signal after the aforementioned filter- 
ing operation and the data rate after compression, and 
then performs quantization by utilizing the changed 
quantization step. 

[0295] The variable-length encoder 2015 performs 
variable-length encoding on the quantized data and var- 
ious attached data. 

[0296] Note that the nineteenth through the twenty- 
second embodiments are realizable by software. 
[0297] With this, even in the case where video signals 
in various formats (resolution, frame frequency, etc.) 
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were input, video signals can be readily stored in or 
reproduced from a storage medium as a single format. 
[0298] While the present invention has been 
described with reference to the preferred embodiments 
thereof, the invention is not to be limited to the details s 
given herein, but may be modified within the scope of 
the appended claims. 

Claims 

10 

1. A method of layering and encoding an input video 
signal on the basis of spatial resolution, comprising: 

a first resolution transformation step of gener- 
ating a second video signal with low resolution is 
from a first video signal with high resolution 
which is said input video signal; 3. 
a first encoding step of encoding said second 
video signal; 

a decoding step of decoding the encoded sec- so 
ond video signal; 

a second resolution transformation step of gen- 
erating a third video signal with the same high 
resolution as said first video signal, based on 
the decoded video signal obtained by decoding 25 
said second video signal; 
a second encoding step of encoding a video 
signal with the same high resolution as said 
first video signal, obtained based on said first 
video signal and said third video signal ; zo 
a high frequency component information output 
step of outputting information on a high fre- 
quency component which is included in said 
first video signal or said second video signal; 
and 35 
an encoding quantity control step of controlling 
an encoding rate at which said second video 
signal is encoded by said first encoding step 
and an encoding rate at which said first video 
signal is encoded by said second encoding 40 
step, based on the output high frequency com- 
ponent information. 

2. An apparatus for layering and encoding a video sig- 
nal on the basis of spatial resolution, comprising: 45 

first resolution transformation means to gener- 
ate a second video signal with low resolution 
from a first video signal with high resolution 
which is an input video signal; so 
first encoding means to encode said second 
video signal; 

decoding means to decode the encoded sec- 4. 
ond video signal; 

second resolution transformation means to ss 
generate a third video signal with the same res- 
olution as said first video signal from the 
decoded video signal of said second video sig- 



nal; 

second encoding means to encode said first 
video signal, based on a time axis correlation of 
the first video signal and based on said third 
video signal as a predicted video signal; 
frequency distribution measuring means to 
measure a frequency distribution of Said first 
video signal; and 

encoding quantity control means to control an 
encoding rate at which said second video sig- 
nal is encoded by said first encoding means 
and an encoding rate at which said first video 
signal is encoded by said second encoding 
means, based on the measured frequency dis- 
tribution. 

An apparatus for layering and encoding a video sig- 
nal on the basis of spatial resolution, comprising: 

first resolution transformation means to gener- 
ate a second video signal with low resolution 
from a first video signal with high resolution 
which is an input video signal; 
first encoding means to encode said second 
video signal; 

decoding means to decode the encoded sec- 
ond video signal; 

second resolution transformation means to 
generate a third video signal with the same res- 
olution as said first video signal from the 
decoded video signal of said second video sig- 
nal; 

differential signal generating means to gener- 
ate a fourth video signal which is a differential 
signal between said first video signal and said 
third video signal; 

motion detection means to detect motion from 
said first video signal; 

second encoding means to encode said fourth 
video signal, based on the detected motion of 
said first video signal; 

frequency distribution measuring means to 
measure a frequency distribution of said first 
video signal; and 

encoding quantity control means to control an 
encoding rate at which said second video sig- 
nal is encoded by said first encoding means 
and an encoding rate at which said fourth video 
signal is encoded by said second encoding 
means, based on the measured frequency dis- 
trbution. 

An apparatus for layering and encoding a video sig- 
nal on the basis of spatial resolution, comprising: 

first resolution transformation means to gener- 
ate a second video signal with low resolution 
from a first video signal with high resolution 
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which is an input video signal; 

first encoding means to encode said second 

video signal; 

decoding means to decode the encoded sec- 
ond video signal; s 
second resolution transformation means to 
generate a third video signal with the same res- 
olution as said first video signal from the 
decoded video signal of said second video sig- 
nal; w 
motion detection means to detect motion from 
said second video signal; 
second encoding means to encode said first 
video signal, based on a time axis correlation of 
the first video signal and based on said third is 
video signal as a predicted video signal; and 
encoding quantity control means to control an 
encoding rate at which said second video sig- 
nal is encoded by said first encoding means 
and an encoding rate at which said first video 20 
signal is encoded by said second encoding 
means, based on the detected motion of said 
second video signal. 

An apparatus for layering and encoding a video sig- 25 
nal on the basis of spatial resolution, comprising: 

first resolution transformation means to gener- 
ate a second video signal with low resolution 
from a first video signal with high resolution 30 
which is an input video signal; 
first encoding means to encode said second 
video signal; 

decoding means to decode the encoded sec- 
ond video signal; 35 
second resolution transformation means to 
generate a third video signal with the same res- 
olution as said first video signal from the 
decoded video signal of said second video sig- 
nal; 40 
motion detection means to detect motion from 
said first video signal; 

second encoding means to encode said first 
video signal, based on a time axis correlation of 
the first video signal and based on said third 45 
video signal as a predicted video signal; and 
encoding quantity control means to control an 
encoding rate at which said second video sig- 
nal is encoded by said first encoding means 
and an encoding rate at which said first video so 
signal is encoded by said second encoding 
means, based on the detected motion of said 
first video signal. 

An apparatus for layering and encoding a video sig- 55 ' 
nal on the basis of spatial resolution, comprising: 
first resolution transformation means to generate a 



second video signal with low resolution from a 
first video signal with high resolution which is 
an input video signal; 

first encoding means to encode said second 
video signal; 

decoding means to decode the encoded sec- 
ond video signal; 

second resolution transformation means to 
generate a third video signal with the same res- 
olution as said first video signal from the 
decoded video signal of said second video sig- 
nal; 

differential signal generating means to gener- 
ate a fourth video signal which is a differential 
signal between said first video signal and said 
third video signal; 

motion detection means to detect motion from 
said first video signal ; 

second encoding means to encode said fourth 
video signal, based on the detected motion of 
said first video signal ; and 
encoding quantity control means to control an 
encoding rate at which said second video sig- 
nal is encoded by said first encoding means 
and an encoding rate at which said fourth video 
signal is encoded by said second encoding 
means, based on the detected motion of said 
first video signal. 

7. An apparatus for layering and encoding a video sig- 
nal on the basis of spatial resolution, comprising: 

first resolution transformation means to gener- 
ate a second video signal with low resolution 
from a first video signal with high resolution 
which is an input video signal; 
first encoding means to encode said second 
video signal; 

decoding means to decode the encoded sec- 
ond video signal; 

second resolution transformation means to 
generate a third video signal with the same res- 
olution as said first video signal from the 
decoded video signal of said second video sig- 
nal; 

motion detection means to detect motion from 
said second video signal; 
second encoding means to encode said first 
video signal, based on a time axis correlation of 
the first video signal and based on said third 
video signal as a predicted video signal; fre- 
quency distribution measuring means to meas- 
ure a 

frequency distribution of said first video signal; 
and 

encoding quantity control means to control an 
encoding rate at which said second video sig- 
nal is encoded by said first encoding means 
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and an encoding rate at which said first video 
signal is encoded by said second encoding 
means, based on the detected frequency distri- 
bution and the detected motion of said second 
video signal. 5 



8. An apparatus for layering and encoding a video sig- 
nal on the basis of spatial resolution, comprising: 

first resolution transformation means to gener- 10 
ate a second video signal with low resolution 
from a first video signal with high resolution 
which is an input video signal; 
first encoding means to encode said second 
video signal; 75 
decoding means to decode the encoded sec- 
ond video signal; 

second resolution transformation means to 
generate a third video signal with the same res- 
olution as said first video signal from the so 
decoded video signal of said second video sig- 
nal; 

motion detection means to detect motion from 
said f irst video signal; 

second encoding means to encode said first 25 
video signal, based on a time axis correlation of 
the first video signal and based on said third 
video signal as a predicted video signal; 
frequency distribution measuring means to 
measure a frequency distribution of said first 30 
video signal; and 

encoding quantity control means to control an 
encoding rate at which said second video sig- 
nal is encoded by said first encoding means 
and an encoding rate at which said first video 35 
signal is encoded by said second encoding 
means, based on the detected frequency distri- 
bution and the detected motion of said first 
video signal. 

40 

9. An apparatus for layering and encoding a video sig- 
nal on the basis of spatial resolution, comprising: 

first resolution transformation means to gener- 
ate a second video signal with low resolution 45 
from a first video signal with high resolution 
which is an input video signal; 
first encoding means to encode said second 
video signal; 

decoding means to decode the encoded sec- so 
ond video signal; 

second resolution transformation means to 
generate a third video signal with the same res- 
olution as said first video signal from the 
decoded video signal of said second video sig- ss 
nal; 

differential signal generating means to gener- 
ate a fourth video signal which is a differential 
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signal between said first video signal and said 
third video signal; 

motion detection means to detect motion from 
said first video signal; 

second encoding means to encode said fourth 
video signal, based on the detected motion of 
said first video signal; 

frequency distribution measuring means to 
measure a frequency distribution of said first 
video signal; and 

encoding quantity control means to control an 
encoding rate at which said second video sig- 
nal is encoded by said first encoding means 
and an encoding rate at which said fourth video 
signal is encoded by said second encoding 
means, based on the measured frequency dis- 
trixrtion and the detected motion of said first 
video signal. 

10. The apparatus as set forth in claim 2, 3, 7, 8, or 9, 
wherein: 

said frequency distribution measuring means is 
distribution detection means employing a high- 
pass filter; and 

when a high frequency component in said fre- 
quency distribution is small, said encoding 
quantity control means increases the encoding 
rate at which said second video signal is 
encoded. 

11. The apparatus as set forth in claim 2, 3, 7, 8, or 9. 
wherein: 

said first resolution transformation means is 
resolution transformation means employing a 
low-pass filter whose frequency characteristic 
is expressed by F; 

said frequency distribution measuring means is 
distribution detection means employing a high- 
pass filter in which said first video signal is 
expressed with a frequency characteristic of 1 - 
F; and 

when a high frequency component in said fre- 
quency distribution is small, said encoding 
quantity control means increases the encoding 
rate at which said second video signal is 
encoded. 

12. The apparatus as set forth in claim 2, 3, 7, 8, or 9, 
wherein: 

said frequency distribution measuring means is 
means tor detecting the absolute value sum of 
a difference between a fifth video signal gener- 
ated from said second video signal by employ- 
ing said second resolution transformation 
means and said first video signal; and 
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when said absolute value sum is small, said 
encoding quantity control means increases the 
encoding rate at which said second video sig- 
nal is encoded. 

5 

1 3. The apparatus as set forth in claim 2, 3, 7, 8, or 9, 
wherein: 

said frequency distribution measuring means is 
means for detecting the absolute value sum of 10 
a difference between a fifth video signal gener- 
ated from said second video signal by employ- 
ing said second resolution transformation 
means and said first video signal, and when an 
absolute value of said difference is equal to or 75 
less than a predetermined threshold value, 
said frequency distribution measuring means 
adds 0 instead of adding said absolute value; 
and 

when said absolute value sum is small, said so 
encoding quantity control means increases the 
encoding rate at which said second video sig- 
nal is encoded. 

14. The apparatus as set forth in claim 4, 5, 6, 7, 8, or 25 
9, wherein, when the detected motion of said first 
video signal is great, the encoding rate at which 
said second video signal is encoded is increased. 

1 5. The apparatus as set forth in claim 2, 4, 5, 7, 8. 1 0. so 
1 1 , 12, or 13, wherein the sum of the encoding rate 

at which said first video signal is encoded and the 
encoding rate at which said second video signal is 
encoded is fixed. 

35 

16. The apparatus as set forth in claim 3. 6, 9, 10, 1 1, 
12, or 13, wherein the sum of the encoding rate at 
which said first video signal is encoded and the 
encoding rate at which said fourth video signal is 
encoded is fixed. 40 

17. A method of layering and encoding an input video 
signal on the basis of spatial resolution, comprising: 

a first resolution transformation step of gener- 45 
ating a second video signal with low resolution 
from a first video signal with high resolution 
which is said input video signal; 
a first encoding step of encoding said second 
video signal; so 
a decoding step of decoding the encoded sec- 
ond video signal; 

a second resolution transformation step of gen- 
erating a third video signal with the same high 
resolution as said first video signal, based on ss 
the decoded video signal obtained by decoding 
said second video signal; and 
a second encoding step of encoding said first 
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video signal, based on a plurality of encode 
modes; 

wherein, when in said second encoding step 
said encoding is performed by employing an 
encode mode based on bidirectional prediction 
in a time axis direction among said plurality of 
encode modes, only information indicating 
which of said first video signal or said decoded 
video signal is utilized by the encoding in said 
first encoding step or encoding in said second 
encoding step is encoded. 

18. An apparatus for layering and encoding a video sig- 
nal on the basis of spatial resolution, comprising: 

first resolution transformation means to gener- 
ate a second video signal with low resolution 
from a first video signal with high resolution 
which is an input video signal; 
first encoding means to encode said second 
video signal; 

decoding means to decode the encoded sec- 
ond video signal; 

second resolution transformation means to 
generate a third video signal with the same res- 
olution as said first video signal from the 
decoded video signal of said second video sig- 
nal; and 

second encoding means to encode each frame 
of said first video signal by at least one of the 
encode modes among (1) spatial inter-resolu- 
tion predictive coding which employs prediction 
in a spatial axis direction employing said third 
video signal, (2) intraframe coding which 
employs only data within said frame, (3) inter- 
frame forward predictive coding which employs 
forward prediction in a time axis direction, and 
(4) interframe bidirectional predictive coding 
which employs bidirectional prediction in the 
time axis direction; 

wherein, when said interframe bidirectional 
predictive coding is performed by said second 
encoding means, only a motion vector obtained 
by interframe bidirectional prediction is 
encoded. 

19. An apparatus for layering and encoding a video sig- 
nal on the basis of spatial resolution, comprising: 

first resolution transformation means to gener- 
ate a second video signal with low resolution 
from a first video signal with high resolution 
which is an input video signal; 
first encoding means to encode each frame of 
said second video signal by either (1) intra- 
frame coding which employs only data within 
said frame, (2) interframe forward predictive 
coding which employs forward prediction in a 



JDOCID: <EP 0901289A2_I_> 



28 



55 



EP0 901 289 A2 



56 



time axis direction, or (3) interframe bidirec- 
tional predictive coding which employs bidirec- 
tional prediction in the time axis direction; 
decoding means to decode the encoded sec- 
ond video signal; 5 
second resolution transformation means to 
generate a third video signal with the same res- 
olution as sad first video signal from the 
decoded video signal of said second video sig- 
nal; and w 
second encoding means to encode each frame 
of said first video signal by at least one of the 
encode modes among (1) spatial inter-resolu- 
tion predictive coding which employs prediction 
in a spatial axis direction employing said third 75 
video signal, (2) intraframe coding which 
employs only data within said frame, (3) inter- 
frame forward predictive coding which employs 
forward prediction in a time axis direction, and 
(4) interframe bidirectional predictive coding 20 
which employs bidirectional prediction in the 
time axis direction; 

wherein, when said interframe bidirectional 
predictive coding is performed by said second 
encoding means, only a motion vector obtained 25 
by interframe bidirectional prediction is 
encoded. 

20. The apparatus as set forth in claim 19, wherein, 
when said first encoding means performs said intra- 30 
frame coding, said second encoding means 
encodes a frame corresponding to the frame by 
said intraframe coding. 

21. The apparatus as set forth in claim 19, wherein, 35 
when said first encoding means performs said inter- 
frame bidirectional predictive coding, said second 
encoding means encodes a frame corresponding to 
the frame by either said intraframe coding or said 
interframe forward predictive coding. 40 

22. The apparatus as set forth in claim 19, wherein, 
when said first encoding means performs said intra- 
frame coding, said second encoding means 
encodes a frame corresponding to the frame by 45 
only said spatial inter-resolution predictive coding. 

23. The apparatus as set forth in claim 19, wherein, 
when said first encoding means performs either 
said interframe forward predictive coding or said so 
interframe bidirectional predictive coding, said sec- 
ond encoding means utilizes a motion vector 
obtained by multiplying the motion vector detected 

at said first encoding means by a predetermined 
number and encodes a frame corresponding to the ss 
frame encoded by said first encoding means with 
the same encode mode as the encode mode of said 
first encoding means. 



24. The apparatus as set forth in claim23, wherein said 
second encoding means does not encode the 
motion vector obtained by multiplying the motion 
vector detected at said first encoding means by a 
predetermined number. 

25. An apparatus for layering and encoding a video sig- 
nal on the basis of spatial resolution, comprising: 

first resolution transformation means to gener- 
ate a second video signal with low resolution 
from a first video signal with high resolution 
which is an input video signal; 
first encoding means to encode said second 
video signal; 

decoding means to decode the encoded sec- 
ond video signal; 

second resolution transformation means to 
generate a third video signal with the same res- 
olution as said first video signal from the 
decoded video signal of said second video sig- 
nal; and 

second encoding means to encode each frame 
of said first video signal by at least one of the 
encode modes among (1) spatial inter-resolu- 
tion predictive coding which employs prediction 
in a spatial axis direction employing said third 
video signal, (2) intraframe coding which 
employs only data within said frame, (3) inter- 
frame forward predictive coding which employs 
forward prediction in a time axis direction, and 
(4) interframe bidirectional predictive coding 
which employs bidirectional prediction in the 
time axis direction; 

wherein said second encoding means encodes 
frames of said first video signal at intervals of a 
predetermined number of frames by said spa- 
tial inter-resolution predictive coding alone. 

26. An apparatus for layering and encoding a video sig- 
nal on the basis of spatial resolution, comprising: 

first resolution transformation means to gener- 
ate a second video signal with low resolution 
from a first video signal with high resolution 
which is an input video signal; 
first encoding means to encode said second 
video signal; 

decoding means to decode the encoded sec- 
ond video signal; 

second resolution transformation means to 
generate a third video signal with the same res- 
olution as said first video signal from the 
decoded video signal of said second video sig- 
nal; 

second encoding means to encode each frame 
of said first video signal by at least one of the 
encode modes among (1) spatial inter-resolu- 
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tion predictive coding which employs prediction 
in a spatial axis direction employing said third 
video signal, (2) irrtraframe coding which 
employs only data within said frame, (3) inter- 
frame forward predictive coding which employs 5 
forward prediction in a time axis direction, and 
(4) interfrarne bidirectional predictive coding 
which employs bidirectional prediction in the 
time axis direction; and 

motion vector detection means to detect a 10 
motion vector between frames of said first 
video signal; 

wherein said second encoding means per- 
forms encoding by employing the motion vector 
detected by said motion vector detection is 
means, and said first encoding means per- 
forms encoding by employing a motion vector 
obtained by multiplying the motion vector 
detected at said motion vector detection means 
by a predetermined number. 20 

27. The apparatus as set forth in claim 26, wherein 
either said second encoding means or said first 
encoding means encodes either the motion vector 
detected by said motion vector detection means or 25 
a motion vector obtained by dividing the motion 
vector detected at said motion vector detection 
means by a predetermined number. 

28. A method of layering and encoding an input video 30 
signal on the basis of spatial resolution, comprising: 

a first resolution transformation step of gener- 
ating a second video signal with low resolution 
from a first video signal with high resolution 35 
which is said input video signal; 
a first encoding step of encoding said second 
video signal; 

a decoding step of decoding the encoded sec- 
ond video signal; 40 
a second resolution transformation step of gen- 
erating a third video signal with the same high 
resolution as said first video signal, based on 
the decoded video signal obtained by decoding 
said second video signal; 45 
a differential signal generation step of comput- 
ing a data difference between frames of said 
first and third video signals which correspond 
with each other and generating a differential 
signal; so 
a band dividing step of dividing the generated 
differential signal into a plurality of predeter- 
mined bands and generating a band dividing 
signal; and 

a second encoding step of encoding the gener- ss 
ated band dividing signal. 

29. An apparatus for layering and encoding an input 



video signal on the basis of spatial resolution, com- 
prising: 

first resolution transformation means to gener- 
ate a second video signal with low resolution 
from a first video signal with high resolution 
which is said input video signal; 
first encoding means to encode said second 
video signal; 

decoding means to decode the encoded sec- 
ond video signal; 

second resolution transformation means to 
generate a third video signal with the same 
high resolution as said first video signal, based 
on the decoded video signal obtained by 
decoding said second video signal; 
differential signal generation means to com- 
pute a data difference between frames of said 
first and third video signals which correspond 
with each other and generate a differential sig- 
nal; 

band dividing means to divide the generated 
differential signal by said differential signal gen- 
eration means into a plurality of predetermined 
bands and generate a band dividing signal; and 
second encoding means to encode said band 
dividing signal generated by said band dividing 
means. 

30. A digital broadcast decoding method of decoding a 
broadcasting signal compressed by the Moving Pic- 
ture Experts Group (MPEG) standard and multi- 
plexed, comprising: 

a demodulation step of performing a predeter- 
mined demodulation on said broadcasting sig- 
nal; 

a separation step of separating the demodu- 
lated broadcasting signal into a video signal 
compressed stream and an audio signal com- 
pressed stream on a first channel; 
a first video signal decoding step of decoding 
the separated video signal compressed stream 
present on said first channel; 
a first audio signal decoding step of decoding 
the separated audio signal compressed stream 
present on said first channel; and 
a second video signal decoding step of decod- 
ing a video signal compressed stream present 
on a second channel different from said first 
channel; 

wherein in said second video signal decoding 
step, (1) the video signal compressed stream 
on said second channel is decoded, (2) a 
motion vector, and a DC component in DCT 
coefficients are extracted, or a DC component 
and some of DCT coefficients excluding the DC 
component are extracted, and (3) based on the 
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extracted contents, said second video signal is 
decoded/ 

31. A digital broadcast decoding apparatus for decod- 
ing a broadcasting siganal which is generated from s 
a video signal and an audio signal which are com- 
pressed by the Moving Picture Experts Group 
(MPEG) standard, multiplexed and modulated, 
comprising: 

w 

a demodulating section to perform a predeter- 
mined demodulation on said digital broadcast- 
ing signal; 

a separating section to separate the demodu- 
lated broadcasting signal into a video signal is 
compressed stream and an audio signal com- 
pressed stream on at least one channel by 
releasing said multiplexing; 
a first video signal decoding section to decode 
the separated video signal compressed stream 
present on a predetermined channel; 
an audio signal decoding section to decode the 
separated audio signal compressed stream 
present on said predetermined channel; 
a second video signal decoding section to 
decode a video signal compressed stream 
present on a channel other than said predeter- 
mined channel and to output the decoded sig- 
nal; and 

a video signal overlaying section to overlay a 
video signal output of sad second video signal 
decoding section at a predetermined position 
on a video signal output of said first video sig- 
nal decoding section and to output the overlaid 
signal; 

wherein said second video signal decoding 
section has: 

a variable-length decoder which (1) variable- 
length decodes said video signal compressed 
stream, (2) extracts a motion vector and a DC 
component, or (3) extracts a quantization step 
when said DC component is quantized, the 
quantization step being a divisor employed in 
the quantization; 

inverse differential pulse code modulation 
(DPCM) unit to perform inverse DPCM only 
when DPCM has been performed on said DC 
component; 

an inverse quantizer to perform inverse quanti- 
zation only when said DC component has been 
quantized; 

memory to store the decoded video signal; 
a motion compensator to compensate motion 
by employing both a video signal compensated 
and decoded after said motion vector has been 
transformed by a predetermined transforma- 
tion and a video signal stored in said memory; 
and 



a memory controller to control writing of data to 
said memory and reading of data from said 
memory. 

32. The digital broadcast decording apparatus as set 
forth in claim 31, wherein said predetermined trans- 
formation is to multiply said motion vector by 1/8. 

33. A digital broadcast decoding apparatus for decod- 
ing a broadcasting siganal which is generated from 
a video signal and an audio signal which are com- 
pressed by the Moving Picture Experts Group 
(MPEG) standard, multiplexed and modulated, 
comprising: 

a demodulating section to perform a predeter- 
mined demodulation on said digital broadcast- 
ing signal; 

a separating section to separate the demodu- 
lated broadcasting signal into a video signal 
compressed stream and an audio signal com- 
pressed stream on at least one channel by 
releasing said multiplexing; 
a first video signal decoding section to decode 
the separated video signal compressed stream 
present on a predetermined channel; 
an audio signal decoding section to decode the 
separated audio signal compressed stream 
present on said predetermined channel; 
a second video signal decoding section to 
decode a video signal compressed stream 
present on a channel other than said predeter- 
mined channel and to output the decoded sig- 
nal; and 

a video signal overlaying section to overlay a 
video signal output of said second video signal 
decoding section at a predetermined position 
on a video signal output of said first video sig- 
nal decoding section and to output the overlaid 
signal; 

wherein said second video signal decoding 
section has: 

a variable-length decoder which (1) variable- 
length decodes said video signal compressed 
stream and (2) extracts a motion vector, a 
quantization step which is a divisor employed in 
quantization, and MxN DCT coefficients con- 
sisting of M coefficients in a horizontal direction 
(where M is a natural number from 1 to 8) and 
N coefficients in a vertical direction (where N is 
a natural number from 1 to 8); 
an inverse quantizer to quantize said MxN 
DCT coefficients inversely; 
memory to store the decoded video signal; 
a motion compensator to compensate motion 
by employing both a video signal compensated 
and decoded after said motion vector has been 
transformed in horizontal and vertical direc- 
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tions by a predetermined transformation and a 
video signal stored in said memory; and 
a memory controller to control writing of data to 
said memory and reading of data from said 
memory. s 

34. The digital broadcast decording apparatus as set 
forth in claim 33, wherein said predetermined trans- 
formation is to multiply said motion vector by M/8 in 
the horizontal direction and N/8 in the vertical direc- 10 
tion. 

35. The digital broadcast decording apparatus as set 
forth in claim 31 or 33, wherein said second video 
signal decoding section comprises K second video 75 
decoding sections where K is a natural number 
equal to or greater than 1 and wherein said video 
signal overlaying section overlays video signal out- 
puts of said K second video signal decoding sec- 
tions at a predetermined position on a video signal 20 
output of said first video signal decoding section 
and then outputs the overlaid signal. 

36. A system for decoding a video signal on which a 
predetermined encoding operation has been per- 25 
formed, comprising: 



37. The system as set forth in claim 36. wherein said 
predetermined transformation is to multiply said 
motion vector by 1/8. 

38. A system for decoding a video signal on which a 
predetermined encoding operation has been per- 
formed, comprising: 



variable-length decoding means which varia- 
ble-length decodes a video signal compressed 
stream and extracts a motion vector, a quanti- 
zation step which is a divisor employed in 
quantization, and MxN DCT coefficients con- 
sisting of M coefficients in a horizontal direction 
(where M is a natural number from 1 to 8) and 
N coefficients in a vertical direction (where N is 
a natural number from 1 to 8); 
inverse quantizing means to quantize said M x 
N DCT coefficients inversely; 
memory to store a decoded video signal; 
a compensator to compensate motion by 
employing both a video signal compensated 
and decoded after said motion vector has been 
transformed in horizontal and vertical direc- 
tions by a predetermined transformation and a 
video signal stored in said memory; and 
a memory controller to control writing of data to 
said memory and reading of data from said 
memory. 

39. The system as set forth in claim 38, wherein said 
predetermined transformation is to multiply said 
motion vector by M/8 in the horizontal direction and 
N/8 in the vertical direction. 

40. A digital broadcasting signal storing method of 
receiving and storing a broadcasting signal com- 
pressed by the Moving Picture Experts Group 
(MPEG) standard and multiplexed, comprising the 
steps of: 

receiving said broadcasting signal and per- 
forming a predetermined demodulation; 
separating a video signal compressed stream 
from the demodulated broadcasting signal; 
decoding the separated video signal com- 
pressed stream; 

based on a predetermined flag in the decoded 
stream, and/or based on a predetermined 
motion vector and predetermined DCT coeffi- 
cients in the decoded stream, (1) converting 
various formats in said decoded stream to a 
predetermined format, and/or (2) reducing the 
data amount of said decoded stream, and then 
(3) encoding said decoded stream; and 
storing the encoded stream in a predetermined 
storage medium. 

41. A digital broadcasting signal storage for storing a 
broadcast compressed by the Moving Picture 
Experts Group (MPEG) standard, comprising: 

a demodulating section to perform a predeter- 
mined demodulation on a digital broadcast 
which is broadcasted by compressing a video 
signal and an audio signal by the MPEG stand- 



a variable-length decoding means which (1) 
variable-length decodes a video signal com- 
pressed stream, (2) extracts a motion vector 30 
and a DC component, and (3) extracts a quan- 
tization step if said DC component is quan- 
tized, the quantization step being a divisor 
employed in the quantization; 
inverse differential pulse code modulation 35 
(DPCM) means to perform inverse DPCM only 
when DPCM has been performed on said DC 
component; 

means to perform inverse quantization only 
when said DC component has been quantized; 40 
memory to store a decoded video signal; 
a compensator to compensate motion by 
employing both a video signal compensated 
and decoded after said motion vector has been 
transformed by a predetermined transforma- 45 
tion and a video signal stored in said memory; 
and 

a memory controller to control writing of data to 
said memory and reading of data from said 
memory. so 
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and and performing predetermined multiplexing 
and modulation on the video and audio signals; 
a separating section to separate video and 
audio signal compressed streams on a prede- 
termined channel by releasing said predeter- s 
mined multiplexing; 

memory to store the separated audio signal 
compressed stream temporarily; 
a variable-length decoder to perform variable- 
length decoding on the separated video signal 10 
compressed stream and to select various flags, 
motion vectors, and a predetermined number 
of DCT coefficients (M coefficients in a horizon- 
tal direction where M is a natural number from 
1 to 8 and N coefficients in a vertical direction is 
where N is a natural number from 1 to 8); 
a variable-length encoder to perform variable- 
length encoding on the selected various flags 
and motion vectors, by performing a predeter- 
mined flag transformation on the selected vari- 20 
ous flags and also performing a motion vector 
transformation on the selected motion vectors; 
a multiplexing section to multiplex the variable- 
length encoded video signal data and said 
audio signal compressed stream; and 25 
a storage section to store the multiplexed data 
in a predetermined storage medium. 

42. A digital broadcasting signal storage for storing a 
broadcast compressed by the Moving Picture 30 
Experts Group (MPEG) standard, comprising: 

a demodulating section to perform a predeter- 
mined demodulation on a digital broadcast 
which is broadcasted by compressing a video 35 
signal and an audio signal by the MPEG stand- 
ard and performing predetermined multiplexing 
and modulation on the video and audio signals; 
a separating section to separate video and 
audio signal compressed streams on a prede- 40 
termined channel by releasing said predeter- 
mined multiplexing; 

memory to store the separated audio signal 
compressed stream temporarily; 
a variable-length decoder which variable- 45 
length decodes the separated video signal 
compressed stream and selects various flags, 
(1) performs a motion vector transformation 
when a motion vector has been determined in a 
frame unit, (2) converts the motion vector to a so 
frame unit by a predetermined approximation 
method when the motion vector has been 
determined in a field unit, (3) selects only a pre- 
determined number of DCT coefficients (M 
coefficients in a horizontal direction and N coef- ss 
ficients in a vertical direction where M and N 
are a natural number from 1 to 8) when DCT 
coefficients have been determined in a frame 
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unit, and (4) deletes one groip of DCT coeffi- 
cients and selects only a predetermined 
number of DCT coefficients (M coefficients in a 
horizontal direction and K coefficients in a ver- 
tical direction where M and K are a natural 
number from 1 to 8) when DCT coefficients 
have been determined in a field unit; 
a variable-length encoder to perform variable- 
length encoding on the selected various flags, 
motion vectors, and DCT coefficients by per- 
forming a predetermined flag transformation on 
the selected various flags, motion vectors, and 
DCT coefficients; 

a multiplexing section to multiplex the variable- 
length encoded video signal data and said 
audio signal compressed stream; and 
a storage section to store the multiplexed data 
in a predetermined storage medium. 

43. An apparatus for reproducing a video signal and an 
audio signal, comprising: 

a reproducing section to reproduce data stored 
in the digital broadcasting signal storage as set 
forth in claim 41 or 42; 

a separating section to separate the repro- 
duced data into video and audio signal com- 
pressed streams; — 
a video signal decoding section to decode the 
separated video signal compressed stream; 
and 

an audio signal decoding section to decode the 
separated audio signal compressed stream; 
wherein the video signal decoding section has: 
a variable-length decoder to perform variable- 
length decoding on said video signal com- 
pressed stream; 

an inverse quantizer to quantize the variable- 
length decoded data inversely; 
an IDCT unit to perform an inverse M x N or M 
x K DCT (where M, N, and K are a natural 
number from 1 to 8) on the inversely quantized 
data; 

memory to store the decoded video signal; 
a motion compensator to compensate motion 
by employing both a video signal decoded with 
a motion vector and a video signal stored in 
said memory; and 

a memory controller to control writing of data to 
said memory and reading of data from said 
memory. 

44. A digital broadcasting signal storage for storing a 
broadcast compressed by the Moving Picture 
Experts Group (MPEG) standard, comprising: 

a demodulating section to perform a predeter- 
mined demodulation on a digital broadcast 



XOCID: <EP 09O1269A2_L> 



65 



EP0 901 289 A2 



66 



which is broadcasted by compressing a video 
signal and an audio signal by the MPEG stand- 
ard and performing predetermined multiplexing 
and modulation on the video and audio signals; 
a separating section to separate video and s 
audio signal compressed streams on a prede- 
termined channel by releasing said predeter- 
mined multiplexing; 

memory to store the separated audio signal 
compressed stream temporarily; io 
a video signal decoding section to decode the 
separated video signal compressed stream; 
a video signal compression section to com- 
press a video signal which is the output of said 
video signal decoding section ; is 
a multiplexing section to multiplex the video 
signal compressed stream compressed at said 
video signal compression section and said 
audio signal compressed stream; and 
a storage section to store the multiplexed data 20 
in a predetermined storage medium; 
wherein said video signal decoding section 
has: 

a variable-length decoder to perform variable- 
length decoding on said video signal com- 25 
pressed stream; 

an inverse quantizer to quantize the variable- 
length decoded data inversely; 
an IDCT unit to perform an inverse DCT on the 
inversely quantized data; 30 
memory to store the decoded video signal; 
a motion compensator to compensate motion 
by employing both a video signal decoded with 
a motion vector and a video signal stored in 
said memory; and as 
a memory controller to control writing of data to 
said memory and reading of data from said 
memory; and 

wherein said video signal compression section 
has: 40 
a filtering unit to change resolution of a video 
signal by performing a predetermined filtering 
operation on a reproduced video signal of a 
video signal compressed stream during a dig- 
ital broadcast, the reproduced video signal 45 
being the output of the video signal decoding 
section; 

a differential signal generator to generate a dif- 
ferential signal of the filtered reproduced video 
signal by employing said motion vector present so 
in said video signal compressed stream which 
is the output of said video signal decoding sec- 
tion; 

a DCT unit to perform DCT on the differential 
signal; 55 
a quantizer to quantize data after DCT by 
employing said various flags which are input to 
the quantizer; a variable-length encoder to var- 



iable-length encode the output of said quan- 
tizer; and said video signal compression 
section outputs a new video signal compressed 
stream. 
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FIG. 16 
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(54) Apparatus for layered video coding 

(57) A video signal layering-encoding system 
according to the present invention has at least either a 
frequency distribution unit to judge a frequency distribu- 
tion in an input video signal or a motion judgment unit to 
judge the motion of an input video signal. With this, 
encoding quantity control according to the characteris- 
tics of the input video signal can be performed between 
layers. Also, with selection of encode modes and shar- 
ing of a motion vector, the encoded data of a btdirection* 
ally predicted frame can be reduced and the encocfing 
efficiency of a high resolution signal can be increased. 

A digital broadcast decoding system according to 
the present invention can readily display a plurality of 
broadcasting programs on different channels onto a 
small screen within a main screen when digital broad- 
casts are received, by a decoding method in which 
processing is easy, structurally simple circuitry and soft- 
ware. 

In a digital broadcasting signal storage according to 
the present invention, by thinning out OCT coefficients 
to reduce the quantity of data to be stored or to slow 
down the storing speed of requisite data and by addition 
of a video signal decoding section and video signal 
encoding section for encoding video signals again, the 
video signal format in a storage medium can be fixed as 
a single format. 
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(54) Apparatus for layered video coding 



(57) A video signal iayering-encoding system ac- 
cording to the present invention has at least either a fre- 
quency distribution unit to judge a frequency distribution 
in an input video signal or a motion judgment unit to 
judge the motion of an input video signal. With this, en- 
coding quantity control according to the characteristics 
of the input video signal can be performed between lay- 
ers. Also, with selection of encode modes and sharing 
of a motion vector, the encoded data of a bidirectionally 
predicted frame can be reduced and the encoding effi- 
ciency of a high resolution signal can be increased. 

A digital broadcast decoding system according to 
the present invention can readily display a plurality of 



broadcasting programs on different channels onto a 
small screen within a main screen when digital broad- 
casts are received, by a decoding method in which 
processing is easy, structurally si mplecircuitry, and soft- 
ware. 

In a digital broadcasting signal storage according to 
the present invention, by thinning out DCT coefficients 
to reduce the quantity of data to be stored or to slow 
down the storing speed of requisite data and by addition 
of a video signal decoding section and video signal en- 
coding section for encoding video signals again, the vid- 
eo signal format in a storage medium can be fixed as a 
single format. 
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Application Number 



The Search Division considers that the^present-European patent application does notcompty with the — 
requirements of unit/ of invention and relates to several inventions or groups of inventions, namely: 

1. Claims: 1-3, 7-16 

Method or apparatus for layered video coding with a first 
and a second resolution transform step or mean wherein the 
encoder quantizers 1 steps of the first and second encoders 
are controlled based on the output of a high frequency 
component measurement step of the first video signal (the 
high resolution input video signal) or of the second video 
signal (the transformed i.e. low resolution video signal) 



2. Claims: 4-6, 14-16 - 

Nethod or apparatus for layered video coding with a first 
and a second resolution transform step or mean wherein the 
encoder quantizers' steps of the first and second encoders 
are controlled based on the detected motion of the first 
(the high resolution input video signal) or second video 
signal (the transformed i .e. low resolution video signal) 



3. Claim : 17 

Method for layered video coding with a first and a second 
resolution transform step and with a first encoding step and 
a second encoding step having a plurality of encoding modes, 
wherein only information is encoded, which indicates which 
of the first video signal or the decoded video signal is 
utilized by the encoding in the first or second encoding step 



4. Claims: 18-24 

Apparatus for layered video coding with first and second 
resolution transform means and with a first encoder and a 
second encoder having one of four encoding modes, wherein 
only a motion vector is encoded in case of bidirectional 
predictive interframe coding 



5. Claim : 25 

Apparatus for layered video coding with first and second 
resolution transform means and with a first encoder and a 
second encoder having one of four encoding modes, wherein 
the second encoder encodes frames of the first video signal 
(the high resolution input video signal) at intervals of a 
predetermined number of frames by the spatial 
inter-resolution predictive coding alone 



6. Claims: 26, 27 
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-The Search Division considers that the present-European patent-application doesrot comply with the 
requirements of unity of invention and relates to several inventions or groups of inventions, namely: 



Apparatus for layered video coding with first and second 
resolution transform means and with a first encoder with 
motion vector detection means and a second encoder having 
one of four encoding modes, wherein the second encoder 
encodes by employing the motion vector and the first encoder 
encodes by employing the same motion vector multiplied by a 
predetermined number 



7. Claims: 28, 29 

Method or apparatus for layered video coding with a first 
and a second resolution transform step or mean and with a 
first and a second encoder, wherein the second encoder 
encodes a generated band dividing differential signal 
between frames of the first video signal (the high 
resolution input video signal) and the third video signal 
(the locally generated high resolution signal, decoded from 
the encoded low resolution signal) 



8. Claim : 30 

Method or apparatus for decoding a multiplexed and modulated 
broadcasting signal with a first and a second video and an 
audio signal 



9. Claims: 31-35 

Apparatus for decoding a multiplexed and modulated 
broadcasting signal with a first and a second video and an 
audio signal and a video signal overlaying section to 
overlay the first and second decoded video signal 



19. Claims: 36-39 

A system for decoding an encoded video signal with 
variable- length decoding means, motion-vector extraction, 
inverse DPCM on DC components, a memory to store a decoded 
video signal, motion compensation with a predetermined 
motion vector transformation and a memory controller 



11. Claim : 40 



A method of storing a digital MPEG broadcasting signal, 
wherein based on a predetermined flag in the decoded and 
separated video stream, and/or based on a predetermined 
motion vector and predetermined DCT coefficients in the 
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The Search-Division considers that the present Europeanpatent- application-does -not-comply with-the 
requirements of unity of invention and relates to several inventions or groups of inventions, namely: 

decoded stream* various formats in the decoded stream are 
converted to a predetermined format, and/or the data amount 
of the decoded stream is reduced and then the decoded stream 
is encoded and stored 



12. Claims: 41-43 

A signal storage and a reproducing apparatus for a MPEG 
broadcast signal comprising a transcoder to select and to 
re-encode various flags and motion vectors by performing a 
predetermined flag transformation and also a motion vector 
transformation on selected motion vectors 



13. Claim : 44 

A digital broadcasting signal storage for a MPEG broadcast 
signal comprising a transcoder, wherein the video signal 
compression section has a filtering unit to change 
resolution of a video signal by performing a predetermined 
filtering operation on a reproduced video signal and the DCT 
performs DCT on a differential signal employing the motion 
vector present in the decoded video stream 
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